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ABSTRACT 

This background paper analyzes technologies for 
tomorrow's information superhighways. Advanced networks will first be 
used to support scientists in their work, but will soon be deployed 
more widely in business, entertainment, health care, and education. 
Significant progress has been made toward the development of gigabit 
network technology since the basic characteristics of the design of 
broadband networks began to emerge in the mid*~1980s. No 
insurmountable technological barriers to the gigabit National 
Research and Education Network (NREN) a'^pear to exist, as work in the 
testbeds (i.e., initial testing programs) is demonstrating. Testbed 
networks model the configuration in which the technology is expected 
to be deployed, in that test sites are separated by realistic 
distances and realistic technological applications will be used. 
Testbed applications research helps researchers understand how the 
NREN can be used to achieve science goals and as a testbed in itself, 
demonstrating technology that can be deployed more widely. The 
following topics are reviewed: (1) the Internet; (2) broadband 
network technology; (3) gigabit research; and (4) application of 
testbed research. One table and 17 figures illustrate the discussion. 
Highlighted points are summarized in 10 boxes. (SLD) 
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F. 



oreword 



Computer networks are having dramatic impacts on our lives. What were 
once esoteric tools used only by scientists and engineers are becoming 
more widely used in schools, libraries, and businesses. At the same 
time, researchers are working to develop even more capable networks 
that promise to change fundamentally the way we communicate. 

This background paper analyzes technologies for tomorrow's informa- 
tion superhighways. Advanced networks will first be used to support scientists 
in their work, linking researchers to supercomputers, databases, and scientific 
mstniments. As the new networks are deployed more widely, they will be used 
by a broader range of users for business, entertainment, health care, and educa- 
tion applications. 

The background paper also describes six test networks that are being 
funded as part of the ffigh Performance Computing and Communications 
Program. These test networks are a collaboration of government, industry, and 
academia, and allow researchers to try new approaches to network design and to 
attack a variety of research questions. Significant progress has been made in the 
development of technologies that will help achieve the goals of the High- 
Performance Computing Act of 1991. 

This is the third publication from OTA*s assessment on information 
technology and research, which was requested by the House Committee on 
Science, Space, and Technology and the Senate Committee on Commerce, 
Science, and Transportation. The first two background papers. High 
Performance Computing & Networking for Science and Seeking Solutions: 
High-Performance Computing for Science, were published in 1989 and 1991, 
respectively. 

OTA appreciates the assistance of the National Science Foundation, the 
Advanced Research Projects Agency, the Department of Energy, the National 
Aeronautics and Space Admimstration, and many experts in industry and acade- 
mia who reviewed or contributed to this document. The contents of this paper, 
however, are the sole responsibility of OTA. 
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Introduction 

and 
Summary 



1 



The vision of the Nation's future telecommunications 
system is that of a broadband network (see box 1-A) that 
can siq)port video* sound, data, and image conununica- 
tions. Ibward this end, the High-Perfomumce Comput- 
ing Act of 1991 called for the Federal computer networks that 
connect universities and Federal laboratories to be upgraded to 
''gigabit networks** (see box 1-B) by 1996.* This background 
pzpcr reviews technologies that may contribute to achieviag this 
objective, and describes the six prototype gigabit networks or 
''testbeds** that are being funded as part of the Federal High 
Performance Computing and Communications Program. These 
prototype networks are intended to denu>nstrate new communi- 
cations technologies, provide experience with the construction of 
advanced networks, and address some of the unresolved research 
questions. 

FEDERAL SUPPORT FOR GIGABIT NETWORKING 

The High Performance Confuting and Communications 
Program (HPCC) is a multiagency program that supports 
reseerch on advanced supercomputers, software, and networks.^ 
In part, these technologies are being developed to attack the 
''Grand Challenges'*: science and engineenng problems in 
climate change, chemistry, and other areas that can only be 
solved with powerful computer systems. Network research is one 
of four conq[>onents of the HPCC program, and represents about 
15 percentof the program*sannual budget of close to$l billion.^ 



» Hig^^PofonniDce Computiiig Act of 1991 (HPCA). PL 102-194. Sec. 102(a). 

2 Office of Scfencc and Tbchoology Policy (OSTP). "Grand Chftlkoges 1993: High 
Perfon&MceCooifwtiDf aodCoiniaynicaiioos,** 1992. 

3 Ibid,, p, 2S. 



The HPCC 
program funds 
the development 
of new 

communications 
technologies. 
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Box Broadband Networks 

ConH)uttrsandn0twork8handein^^ ^^Qura 1-A-1— Digital Data 

tk)n as patterm of alactronic or optical signals. 

Taxt piduras, sound, vidao, and numarical Electrical or optical signal 

data can than ba storad on floppy disics, usad 
In computations, and sant fnMn computar to 
oomputar through a natwortc In itgiU comput* 
arsornatwoi1cs,thaalactronte or optical signals 
that raprasant information can taioa on ona of 
two vaHias, such as a high or a low voltaga, 
which ara usuaNy thought of aithar as a or 
a^O" (figura 1-A-1). Thasa IsandOsaracaliad 
bits. 



Binary representation 

"V' "0" "0" "1" "1" "0" "1 " "0" "1 " "0" 

SOURCE: Off {o# of Technology AssM$m«nt. 1 993. 



Diffsrant patterns of Isand OS arausadto raprasant diflerantldnds of data. Inmost comp^ 
Is raprasantad by the pattern of aiactronic signals corrasponding to "01000001." To raprasant Images, different 
patter ns of btts are used 10 raprasant different shades (from light to dar^ 
the same way, except that the patterns of bits raprasant the Intensity of sound at points in 

The number of bits required to represent information depends on a number of 
of the representation. A good quality, high^esoiution image would raquira more bits than a low-resolution Image. 
Also, some kinds of Information inherently require more bits in order to be represented accurately. Apagecf abook 
with only text might contain a few thousand characters, and coukl be represented with a few tens of thousands 
of bits. A page of Image data, on the other hand, couM require millk>ns of bits. 

Because Images and vWeo, whk^h is a sequence of images, require many more bits to be represented 
accurately, they have strained the capabilities of computers and networks. Images take up too much space In a 
a)mputer'$ memory, and take too tong to be sent through a network to be practical^ 
technotogies described in this background paper have the ability to support twcHway digital. Image, and vMeo 
communicatkxis In a rwjra efficient manner. 

Digital Natworka 

In the past, networks designed foi vkieo or sound used anaibg transmission. In the oM anak)g telephone 
network, for example, the telephone's microphone converted the spoken sounds into an eiectncal signal whose 



The other three coxxqponents of the program target 
supercomputer design, software to solve the 
Grand Challenges, and research in computer 
science and mathematics. 

The HPCC program is the most visible source 
of Federal funds for the development of new 
conununications technology. Tbenetworidng com- 
ponent of the program is divided into two parts: 
1) research on gigabit network technology, and 2) 
developing a National Research and Education 



Network (NREN). The gigabit research program 
supports research on advanced network technol- 
ogy and the development of the six testbeds. The 
NREN program supports the deployment of an 
advanced network to improve and broaden net- 
work access for the research and education 
community. The High-Performancc Computing 
Act of 1991 specifies that the NREN should 
operate at gigabit speeds by 1996, if technically 
possible.^ 



* HPCA, op. cit, footnote 1 . 
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strength oormponcM to tht loudnm of tht 
It iVttchMi its ditfnaten, wh^ 
toundi. 

fMAiorto tmnmtt irrfor 
Wgh-ips»dc«nmunic >ti on t t)tNMncon^ 
cw^tmnimHfttf^woiMIn^^ 
MUi«Jtoi«priMitttoirridnni!ionindig^ 
ofUandOi^oorrMpoiidnotothtloudnmortto 
tto ditftal taliptont and iMd to rtcTMtt tht or^ 
nttwofto.1hay am nMdid totmntmttttogr^ 
Wonnatlor. moia citarty, ¥«hout Wi^^ 
fwtwofk to carry al typat o( iiAirm^ 
nitworiO,ocmputarcoiwnu*a^ 
orotharipadiiU2adn0twori>?).B 
a*(^digitainalwoffcGanpot«rtta^ 
howavar (taa oh. 2 and dt 3). 

Broadband Natworks 

Tha capacity ofad^talnatwodcboftandsacrbad in ttrm 
from plaoa to plaoa avory MGond. A digital taiephona netwo^ 
suNteM capacity to carry a tatophons convarsatk^ 
Although Mcm vUaotatophonM can uaa regular tal^^ 

prafarto usa ipadai sanricas that cantransmit at 384.000 bits par saoonda mora. VCR•qual^^/talavision naads 
about 1£ milionbitsparsaoond, and high^Minitiontala^^ 
timas tha capacity of a digital talaphona lint. 

Tha capacity of a nstwoiK msasurad asthe number of bits it can 
Engineers ollan talc about "narrowband" networks, whteh are low bandwidth networks, and "broadband" 
networks,whk*ara high bandwkth networks. ThedivWIng line batwaanthatwo^ 
as tachnotogy avolvas. Today, any kind of network that transmits at mora than 1 00 miltkm bits per second wouM 
definitely ba conekJeiad a bro«l)and networie Chapter 3 describe 
bt used to build broadband networks. 

SOURCE: OfSoi^ ol TMhootogy AtMwmMt 1903. 



Broadband networks such as the NREN will 
both improve the performance of existing impli- 
cations and accommodate new types of aqjplica- 
tions. There will likely be a shift to image- and 
video-based conmiunications, which are not ade- 
quately supported by currently deployed network 
technology. "Multimedia'' applications that us^ 
images and video, as well as text and sound, look 
promising in a number of areas, e.g., education, 
health care, business, and entertainment Broad- 
band networks will also allow a closer coupling of 
the computers on a netwoiic; as the network is 



removed as a bottleneck, the computers will be 
able to form an integrated system that performs as 
a single, more powerful, computer. 

Broadband networks will require a fundamen- 
tal rethinking of network design. Several new 
concepts have been proposed and are being 
investigated by die testbeds. Fiber is a highly 
touted technology for constructing broadband 
networks, but it alone is not sufficient. Switches 
(see box 1-C) and the components that link 
computers to the networic wil^ have to be up- 
graded at the same time in order to keep pace with 
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Box 1-&-Gigabit Networks 

lyiuch of the resaafch described in this baci^^ 
broadband networks that can transmit data at ont biyion bits par second or more (a "gigabir is one bilion bits; 
''gigabit per second^ is abbreviated as Gfc/s or Gbpe). Tliis represents a 20^ 
linl(S in the networks that currerilly serve the research and educ^ 
Foundation nstwori(usesiiftothattFansmitdetaat45miUonU^ 
even this capacity has not been fuiy utHi2»d because of bottlenecks in th^ 
ofagigafait network iscn ambitious targsl--mo6t current Incfc^ 
with lower bandwkfths, in the 150 milkNi bits per second range. 

The basic outlines of the technok>gy evolution of the DOD, NASA, DOE, and NSF networks that senm 
research and educatk)n were established in 1967 and 1960 reports issued by the Office of Science and 
Technology Policy* In the laie 19e0s, link bandwkfths in the F&iml networks were 1.5 lA/s or less. The OSTP 
reports outlined a three^tagia plan for the evolution of these networta to gig^ 

(see figure 1-B-1). The gigabit target was also specified by the hOgh-Performance Computing Act of 1991, The 
OSTP report envi8k)ned that each generation of technok)gy would move from an experimental phase in the 
Federal networks to commercial service. 

Figure Timetable for the National Research and Education ^Setwork 



Operational njefwork 



Stage 3 
Gbits/sec 



Stage 2 
45 mbps 



Stage 1 
1 .5 mbps 



Operational network 



1 Experimental networks ^ — ^ 


Research and development 


Transition 






Revolutionary 




^y"^ to commercial 


technology 




/ services 


changes 









> 




y .... 


Evolutionary 






changes 








Operational network 





Stages 1 & 2 R&D 



89 90 91 92 93 94 95 96 

SOURCE: Of1k» of Scl«nc» and T«chnotogy Policy. *Th# F*d*r«l High P«fforni«nc« Computing Progrwn," S«pt«mb«r 8, 198d. 

Currently, the Federal agency networks are in the middle phases of the second stage, the operation of 
networks with 45 Mb/s liiAs. At the same time, research and devek)pment for the third stage, the deployment of 
gigabit networks, Isunderway. lnpractk»,thenetworkcapadtywlHnotiumpdirectlyfrom45Mb/stogigabft 
The next step wiH be to 155 Mb/s, then to 622 Mt/s, and then to greater than one gigabit per second Tlie 
bandwkfths used in computer networks (1.5 Mb/s, 45 Mb/s, 155 Mb/s, and 622 Mb/s) correspond to standards 
chosen by manufacturers of transmisskm equipment 

SOURCES: Offk^MSdcnM and TKtKwtooyPol^ 

Nov. 20. 19t7; OSTP. •Th^ FWtral HiQh^^trfofiwwo* Computing Progwn/ StpL S, lOiS; HloW»«ffefmMet Compirting Actd 1991 
(HPCA). Public Uw 102-194, Sm. 102(a). 
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Box 1-C-Computer Network Components 

Acomputarnotwork hu thrM main oomponants: computtrs» links, and twAchet (figura 1-01). Tte w«bof 
links and swftchas carry data botwaan tha oomputars. Links ara n«da of soppar (aithar Iwistad piiT or "ooaxiat 
caUal Of fbar optkB. Trinsmbakmaquf)^ 

sionala.11iara ara also satalita ami mkxovrava links that sand radk) wavas thnxigh tha air. Rbar has aavaral 
ad¥ankaoaa ow othar types of Hnks-Himt n^ 
natwoihsaraairaadycommarcialya\rwMbia.Ho^ 
In othar natwork oomponants ara addc^assad 

Figure l-C-1— A Simple Computer Network 




Link 



Switch 




SOURCE: Off lo« of Technology AsMssm«nt. 1 993. 

For exampia, new high-capadty switches ara needed to keep pace with the higher t)andwklth of fiber optk) 
links. Just as laikoad s^i^ritehes direct trains frm 
f ran link k> link / . the lnforimtk>n travels through ^ 

next In ordar to reach Its destination. The mtes by whk^h the swildies and users' computers coordinate the 
transmisskxi of infdrmatkm through the networic are called protocoU, 

VVhllemostcomputarnahirari(saralimitedkitherabi^^ signals such asvkJso, cable 

televiston netwoiks are wklety used to distribute televisk>n signals to homes. However, cable networks usually do 
not have switches. For this reasoa they only permit one-way comnnunkatkHis: the signai is simply broadcast to 
everyone on the networie Much of tha network rssaarch today Is devoted to the davel^^ 
atow networks to support two-way, high-bandwkith communk:;;^tk)ns. 

SOURCE: Offlot of T«dviology Ammumti, 1993. 



the faster flow of data. Broadband networks will 
be more than simply higher bandwidth versions of 
today's networks, however. Networks will also be 
redesigned so that a single type of network can 
carry video, sound, data, and image services. The 
existing telephone and data networks do not have 



sufficient flexibility to carry all types of informa- 
tion efficiently. 

I The NREN 

One objective for the NREN is that it serve as 
an enabling technology for science and engineer- 
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ing research.^ The gigabit NREN wiU be able to 
handle the very large data sets generated by 
siq)crconqmtcrs. Scientists could use the gigabit 
NREN to support visualization/' dxe use of a 
con^mtcr-generatcd picture to represent data in 
image form- For exano^le, ocean tenaperaturcs 
con:5>uted by a climate model could be repre- 
sented by different colors superinqwscd on am^ 
of the world, instead of a list of numbers* 
Visualization is an essential technique for under- 
standing the results of a simulation. Currently, 

much of the data 
collected in ex- 
periments and 
computcdby sim- 
ulations goes un- 
used because of 
the time needed 
to compute im- 
ages on conven- 
tional computers. 



ffroadband 

networks will require 
a fundamental 
rethinking of 
network design. 



Supercomputers could perform the computations 
more quickly, but few laboratories have supercom- 
puters. With a high-speed network, a scientist 
could send the data to a distant supercomputer, 
which would be able to quickly compute the 
images and send them back through the network 
for display on the scientist's computer. 

A second objective for the NREN program is 
that it demonstrate and test advanced broadband 
communications technologies before they are 
deployed in commercial networks. The NREN 
program will upgrade federally supported net- 
woAs such as the National Science Foundation's 
NSFNET, the Department of Energy's Energy 



Sciences Network (ESnet), and the National 
Aeronautics and Space Administration's NASA 
Science Internet (NSI).^ These networks form the 
core of flie **Intemet," a larger collection of 
intwconnected networks that provides electronic 
mail services axid access to datebases and super- 
con]5)utcrs for users in all parts of the United S tates 
and around the worUL^ During 1992, Federal 
agencies announced plans for upgrading theii- 
current netwwks as part of the NREN program,^ 
The NREN program can be viewed as a 
continuation and expansion of Hit Federal support 
that created the Internet The Internet's technol- 
ogy evolved from that of the Arpanet, a research 
project oflhe Advanced ResearchPtojects Agency. 
Beginning in 1969, the Arpanet served to demon- 
strate the then-new technology of * Vpacket switch- 
ing." Packet switched networics were able to 
support con5)uta: communications q)pUcations 
that could not be efficienfly accommodated by the 
telephone network's **circuit switched" technol- 
ogy (see ch. 2, p. 29). Packet switched networks 
are now widely deployed, Internet services are 
being offered by the private sector, and the 
Internet protocols are becoming world standards. 
Ill much the same way, the NREN program is 
intended to catalyze the deployment of a new 
generation of networic technology. 

Past goverrunent programs have also been 
successful in broadening access to networks for 
the larger research and education community. The 
Internet is increasingly essential to users in the 
academic community beyond the original core 
group of users in engineering and computer 
science. It is now estimated that over 600 colleges 



5F<^.dc«:nptionofthc goals and ch-acter^ 
2 p S uTSnU.. O^cc of Tbchnology Auessment, HigH Performance Computing <t Networking for Science, OTA.BP^-59 

(Wailiiii«mDC:U.S.Gov«m^ 

A Report to Congrew," December 1992, p. 2. 

7RobertE.C^"'nieNetwofkofAUNetworki."TA«NewR>rtTim**.Dec.6.1992,p.F12. 

Dociimcat,'* Feb. 20, 1992. 
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md universities and an estimated 1,000 high 
schools axe connected to the Internet.^ As the 
btemet's user community becomes more diverse, 
there is a growing need for simplifying die 
plications and their user interfaces. 

This background psqpor primarily describes 
gigabit NREN q>plications and network technol- 
ogies* There are, however, several controversial 
policy issues related to the NREN program.^^ 
I^t, the scope of the NREN is uncertain* As a 
key component of the HPCC program, aclear role 
of the NREN is to serve scientists and engineers 
at Federal laboratories, supercomputer centers, 
and major research universities* This objective 
will be met primarily by upgrading the networks 
operated by the National Science Foundation 
(NSF), Dq>artment of Energy (DOE), and the 
National Aeronautics and Space Administration 
(NASA)* However, there are several different 
visions of the extent to which the NREN program 
should also serve abroader academic cotomunity, 
such as libraries and schools. 

A second major issue concerns the ""conmier- 
cialization'' of the NREN. The NREN will 
develop firom the current Internet, which is 
increasingly used by government and businesses, 
not only by the research and education conrniu- 
nity. Several new commercial providers have 
emerged to offer Internet sendees to this madcet, 
which is not served by Federal agency networks. 
One of the goals of the NREN program is to 
continue this commercialization process, while at 



the same time achieving the science and network 
research goals of the NREN program. There has 
been considerable uncertainty about die xnecha* 
nisms by which this objective is to be achieved* 
The High-Perfoimance Cbn9>uting Act does 
not clearly specify the scope of the NREN or die 
mechanism for commercialization* NSF has had 
to address these issues in the course of developing 
a plan for the development of its network* which 
will be a central component of the NREN* These 
debates have slowed considerably the process by 
which NSF will select the companies that will 
operate its network. NSF's original plan, released 
in the summer of 1S>92, is undergoing significant 
revisions (see box 5-A). As of May, 1993, a new 
plan had not been issued* It is increasingly 
unlikely that NSF will be able to deploy its 
next-generation network by the Spring of 1994, as 
was originally plaimed* 

In addition, the groiving commercial impor- 
tance of networking is leading to greater scrutiny 
of the agencies' choices of contractors to operate 
their NREN networks* DOE selected a contractor 
for its component of the NREN in the summer of 
1992, planning to deploy the new network in 
mid-1993* However, a losing bidder protested 
DOE'S selection to the General Accounting 
Office (GAO)* In March, 1993, GAO overturned 
DOE'S choice of contractor and recommended 
that DOE revise its solicitation, conduct discus- 
sions with potential contractors, and allow con- 
tractors a new opportunity to bid*^^ DOE has 



^ Dariecn Fisher, Aaaociite Program Mtcaser, Nadooal Science Fonndation, pcnonai communication, Feb. 11, 1993. 

lOI^issac•IdMedtolfae^ntENpI09nll:^seeHea^il«abeim Subcommittee on Science, Mar. 12, 1992, Serial No. 120. 

1 1 rht <iaq>ttte concerned the parties' imefpittation of certain provisions in DOE's Request for Proposals (RFP). ATAT protested DOE's 
aekction of Sprint to be the contractor for tiie DOE oetworlc, axguiz^ sucess^ 

than had been proposed by Sprint as part of its bid. OAO ruled that the switches that Sprint plamwd to use did not comply with a proi^^ 
in die RFP that pn>po8als had to **C0DchuiveIy demonstrate current availabiUt^ 
coiMrast, was satisfied that the switches bad been developed to the kvd envisioned ^ 
to explore leading-edge technology. 

DOE'S RFP bad specified the use of **ceU reUy* ' technology, wUch is the basis for both Asyncfa^ 
Mallimegabit Data Service <SMDS) services. Amis ej^wcted to play an impoftarx rote in the failure devek>^^ 
nrKl f^r <>ur^w > iii i <r^ri«^ Mnt*ry^ «ihii#> .QMn.Q u intmn^ priniarily M an tntgfaediaie step lowards ATM DOE sctocted Sprint in large 
part becanae Sprint p(«)poiad to begin An4 services imowdiately, whik ATAT bid a service b^ 
1994. E«ty deployinem of An4 would have provided a vahiable oppoftunity to cvah^ 

teclaiology. Comptroller Oeneral of the United Stales, Decision in the Matter of 1993. 
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asked GAO to leconsider its decision. The DOE 
exaxxq>le raises questions about the effect of 
goveminent {Hxxnuement procedures on the abil- 
ity of federal agencies to act as pioneers of 
leading^ge network technology. The additional 
time that would be required to comply with 
GAO's recommendations, added to the seven- 
mcmth GAO process, would delay deployment of 
DOE*s networic by over a year. 

I TheTestbeds 

The HPCC program's six gigabit testbeds 
(table 1-1) are intended to demonstrate emerging 
high-speed network technologies and address 
unresolved research questions. While each 
testbed involves a different research team and is 

en^hasizdngdif* 



Significant 
progress has been 
made toward the 
development of 
gigabit technology. 



faentlopics, there 
is similarity in 
their approach. 
The testbeds typ- 
ically consist of 
abi^-speednet- 
work connecting 
three or four sites 
— unxvensitieStin* 
dustiy laboratories, supercomputer centers, and 
Federal laboratories — ^with high-bandwidth opti- 
cal fiber. Located at each of the testbed sites are 
computers, prototype switches, and other network 
components. Each research group has both net- 
work and s^lications researchers — the s^plica- 
tions will be used to test different ^proaches to 
network design. 

The testbed program is administered by NSF 
and the Advanced Research Projects Agency^^ 
(ARPA). Five of the testbeds are jointly funded 
for 3 years by NSF and ARPA under a cooperative 
agreement with the Corporation for National 
Research Initiatives (CNRI). The principals of 
CNRI, a nonprofit organization, played signifi- 



cant roles in the development of both the Arpanet 
and the Intcmet^^ CNRI is responsible for 
organizing the testbeds and coordinating their 
progress. Funding for the testbeds is modest, 
when compared to their visibility and the overall 
HPCC budget The cooperative agreement with 
CNRI is for $15.8 million over 3 years. Most of 
the cost of building the networks has been borne 
by industry, in the form of contributions of 
transmission cs^pacity, prototype switches, and 
research personnel. 

The testbeds are investigating the use of 
advanced network technology to match the needs 
of the NREN. There is an emphasis on delivering 
the highest bandwidths possible to the users and 
demonstrating the range of s^lications that 
would be used by leading-edge users of the 
NREN. Most of these plications are super- 
computer-based. For example, some applications 
use the network to link several supercomputers, 
allowing their combined processing power to 
confute complex simulations more rapidly . Many 
of the plications being investigated also use die 
network to enable visualization of the results of 
simulations or experiments. 

Initially, only a few users would have comput- 
ers powerful enough to need a gigabit network. 
However, the processing power of lower cost 
workstations and ordinary desktop computers is 
likely to continue to increase rapidly, as a result 
of advances in microprocessor technology. Giga- 
bit networics and the lessons learned from the 
testbeds will then be used more widely. 

SUMMARY 
I Progress 

Significant progress has been made toward the 
development of gigabit network technology since 
1987, when the Office of Science and Tfechnology 
Policy (OSTP) noted that considerable research 
would be needed to determine the design of 



» 2 Ponneriy the Defcaae Advanced Re iCiit h Project! Agency (D ARPA) . 
13 l)r. Robert E. Kaltt U Piesktet of CrOU; Dr. VtatOQ 
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gigabit networks.^^ There has been growing con- 
sensus within the technical commiinity on many 
issues, and the development of the optical fiber 
links, switches, and other netwoik components is 
underway. The testbeds represent the next step in 
the research — integrating the hardware and soft- 
ware components into a working networic system 
and testing it with £q)plications. 

The basic characteristics of the design of 
broadband networks began to emerge in the 
mid-1980s, supported by the results of simula- 
tions and small-scale experiments. Researchers' 
objective was to develop networks that could 



Jf^he testbeds have 
established a useful 
model for network 
research. 



widths and were 
also sufficiently 
flexible to sup- 
port a range of 
services. One 
characteristic of 
these netwoxlcs is 
the use of optical fiber links, which have the 
necessary edacity to support many new services, 
including bandwidth-intensive video- and itnage- 
based applications. The second major characteris- 
dc of the proposed designs for advanced networks 
is the use of ''fast packet switches,** a new type 
of switch that has both the processing power to 
keep up with increases in link bandwidth and the 
flexibility to support several kinds of services. 

As these ideas began to emerge, computer and 
telecommunications companies initiated the de- 
velopment of the network components required 
for broadband networks. There appear to be no 
significant technological barriers to the develop- 
ment of the components required for the gigabit 
NREN. Transmission equipment of the type that 
would be required for the gigabit NREN is 
already becoming available commercially and is 
being used in the testbeds. Some fast packet 



switches are also becoming commercially avail- 
able. Versions of these switches that operate at 
gigabit rates are in prototype fonn and will be 
incorporated in the testbeds over the coming year. 

The testbeds are looking to the next step in the 
research — the development of test networks. This 
is a systems integration task— developing the 
individual components is only part of the process 
of bmlding an advanced network. There is ofien 
much to be learned about making the components 
work together and solving unforeseen problems 
in the implementation. In addition, there are 
research questions that can only be investigated 
with a realistic test network. The testbeds will 
provide a way to test various proposed ap- 
proaches to network design. 

Progress on the testbeds has been slower than 
expected, due to delays in making the transmis- 
sion equipment available and in completing work 
on the switches and other components. Switches 
arc complex sj'stcms, requiring the fabrication of 
numerous electronic circuits. It was originally 
hoped that the optical fiber links could be 
deployed and the gigabit switches and other 
components finished in time to have a year to 
experiment with the working testbed networks 
before the end of the program in mid-1993. It now 
appears that the testb^^ds will not be operational 
until the third quater of 1993. The testbed 
program has been extended to permit a yearns 
research on the testbed facilities once they 
become operational. 

I Testbed Concept 

The testbeds /have established a useful model 
for network research. The design and construction 
of a test network fills a gap between the earlier 
stages of the network research — small scale 
experiments and component development — and 
the deployment of the technology in production 



Office of Science and Ifcchoology PoUcy . "A Research and Developmeoi Strategy fof High Perfonnance Computing/ ' Nov. 20, 1987, 

p. 21. 
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networks. Hie testbed netwoiks mode?, the config- 
uration in which the technology is expected to be 
deployed — die test sites axe i^eparated by realistic 
distances and the netwoiks will be tested with 
supplications of the type expected to be used in the 
gigabit NREN. In addition, the participants in the 
testbeds will play inq>ortant roles when the 
networks are dq)loyed. 

The testbed research contributes in a number of 
ways to a knowledge base that reduces the risks 
involved in deploying advanced network technol- 
ogy. First, there are a number of research issues 
that ace difficult to address widiout a working 
network that can be used to try different Bp- 
proaches. Second, the systems integration process 
provides experience that can be s^Iied when the 
production network is constructed. In many ways 
the experience gained in the process of getting the 
testbeds to work will be as valuable as any 
research done with the operational testbeds. 
Third, the testbeds serve to demonstrate the utility 
of the technology, which serves to create interest 
among potential users and commercial network 
providers. 

Hie relatively small amount of government 
morey invested has been used primarily to 
orgamze and manage the testbeds and to encour- 
age academic involvement. The testbeds have 
mainly drawn on other government and industry 
investment. The organization of the testbeds as a 
collaborative effort of government, academic, and 
industry groups is essential, because of the many 
disciplines required to build and test a netwoik. 
Industiy has contributed expertise in a number of 
areas. For example, it would be too difficult and 
expensive for academic researchers to develop 
the high-speed electronics needed for the switches 
and other components. Academic researchers are 
involved in the Internet community, and have 
contributed ideas for new protocols and applica- 
tions. Other ^plications work has come from a 



number of scientific disciplines and the super- 
con^uter community. 

One of CNRI's main contributions was to 
encourage the involvement of the telecommuni- 
cations carriers m the testbeds. The transmission 
facilities required for the testbeds are expensive 
because of ^e long distances between the testbed 
sites and the demands for very high bandwidth. 
Most experimental work in the past was on smaU 
scale networks in a laboratory, due to the prohibi- 
tive cost of linking distant test sites. However, the 
carriers are installing the required transmission 
capacity and making it available to the testbeds at 
no cost. All three major intecexchange carriers 
(AT&T, MCI, and Sprint), and most of the 
Regional Bell Operating Con:q)anies (RBOCs) 
are playing a role in the testbeds. 

llie testbed research overlaps with industry 
priorities in some areas and not in others. The 
basic design of the netwoiks — the types of 
switches and transmission equipment — reflects 
emerging industry concepts. However, much of 
the research agenda focuses on higher bandwidths 
and more specialized s^lications than will be 
used with commercial broadband networks in the 
near term. Only a few users will use the types of 
supercomputer-based applications being empha- 
sized by the testbeds. Of greater near-term com- 
mercial importance to industry are medium band- 
width ''multimedia'' applications that require 
more bandwidth than can be supported by current 
networks, but significantly less than the gigabit 
speeds required by the superconq)uter commu- 
nity. 

I Application of Testbed Research 

The testbed research is applicable both to the 
NREN and to other networks. The NREN will 
serve only the research and education community 
and is best viewed as only part of the broader 
national information infrastructure. The scope of 
the national information infrastructure will in- 



1^ I^ottiviewof die reUtioDship between the NREN tod the **NAti^ 
the NAtiooal Reseaich ani EdocitioiiNetworic,** EDUCOM Review, voL 26, No. 3, summer 1991, pp. 11-13. 
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elude both the United States' part of the Internet 
and a wide array of other services offered by the 
computer and information industries, the carriers, 
' cable television industry, and others. 

APPUCATIONTONREN 

During 1992, DOE, NASA, and NSF published 
plans for the future development of their net- 
works, a key component in the evolution to the 
gigabit NREN.^^ Some aspects of these plans are 
still imclear, for example, NSF has left to 
prospective bidders the choice of switching tech* 
nology, from among those being investigated by 

the testbeds and 
elsewhere. How- 



Y'herateofNREN 
evolution is less 
dependent on 
technology issues 
than on delays 
in tho selection 
of sen/ice providers. 



ever, the agency 
plans appear to 
be consistent with 
the target estab- 
lished by the 
testbeds. Initially, 
the agency net- 
works will oper- 
ate at lower band- 



widths than the testbed networks, but they will 
incorporate more of the testbed technology as 
they evolve over time to meet the goal of the 
gigabit NREN. 

Today, the highest bandwidth of the agency 
networks is 45 Mb/s; it appears that they will 
move to 155 Mb/s in 1994, with 622 Mb/s the 
highest rate that is realistically achievable by 
1996. The rate of evolution is le dependent on 
technology issues than on delays ii.. the process by 
which the Federal agencies select suppliers of 
NREN network services. Because agei^cy choices 
of technologies and suppliers have broad implica- 
tions for the Internet and the national information 
infirasmicture in general, there have been several 
disputes over agency plans (see p. 7). While the 
NREN program has created a high level of 
interest in advanced networks, further delays in 
the deployment of agency networks may reduce 



the degree to which they will play the role of 
technology pioneers. 

The agency networks' evolution depends in 
part on die timely deployment of the necessary 
high bandwidth transmission infrastructure by the 
telecommunications carriers. Conq>uter networics 
generally use links st^plied by the earners — the 
network operators do not normally put their own 
fiber in the ground. The carriers' netwoiks 
already have gigabit-C2^>acity fiber installed, but 
today the capacity is usually divided among 
thousands of low-bandwidth channels used for 
telephone calls. New transmission equ^ment, tiiie 
electronics at each end of the fiber, is required to 
allow the fiber's capacity to be divided into the 
high-bandwidth channels needed by the gigabit 
NREN. This equipment is being used in the 
testbeds and is becoming available commercially, 
but is very expensive. 

The testbed applications research helps re- 
searchers to understand how the NREN would be 
used to achieve the science goals of the overall 
HPCC program. For example, some of the testbed 
applications show how netwoiks can be used to 
bring greater computer power to bear on complex 
simulations such as the Grand Challenge prob- 
lems. They may also show how networks can be 
used to help researchers collaborate — the Grand 
Challenge teams are expected to invoh^e scien- 
tists at widely separated locations. In 1992, the 
NSF siQ)ercomputer centers proposed the concept 
of a **metacenter,** which uses a high-speed 
network to link the computing power of the four 
NSF supercomputer centers. 

The testbeds do not address all of the technol- 
ogy issues that are key to the future development 
of the NREN. Because the NREN will develop 
£rom the federally funded segment of the current 
Intemet, it is affected by issues related to the 
growing number of users of the Intemet. This 
growth in the number of users is straining some of 
the Intemet protocols, and their future develop- 
ment is a topic of intensive study and debate 



NSF. op. cit.» footnote 8; Leigbtoo, op. cit., footnote 8. 



o 22 

ERIC 



Chapter 1--lntroduction and Summary 1 13 



within the Internet community. Also, the testbeds 
are not looking at applications that would be used 
by a broad range of users in the near term, or at 
issues related to making the Internet applications 
easier to xise. 

OTHER NETWORKS 

One of the roles of the NREN is to serve as a 
testbed in itself, demonstrating technology that 
will then be deployed more broadly in the 
national informadca infrastructure. The testbed 
program will also impact the evolution of the 
national information infirastructure more directly, 
bypassing the inteiuiediate stage of deployment 
in the NREN. This is because the network 
technology used in the testbeds reflects near-term 
industry planning. While the testbeds have em- 
phasized higher bandwidths and more specialized 
applications than are of immediate commercial 
importance, the testbed netwoiks reflect ideas 
that figure prominently in industry plans and. 



wherever possible, use equipment that conforms 
to emerging standards. 

For example, many of the testbeds ms^. a 
switching technology called Asynchronou .. Trans- 
fer Mode or ATM. This technology has become 
central to telecommunications industry planning 
because it is designed to support many different 
kinds of services — today's telephone network 
switches are limited mainly to carrying ordinary 
telephone calls. ATM can s*:5)port Intemet-type 
services such as will be us^^ in the NREN, and 
also video, voice, and other data communications 
serv'c;;s — the carriers plan to use ATM to enter a 
v ariety of markets. Although ATM has been 
widely accepted by the telecommunications in- 
dustry and progress has been made towards its 
implementation, there are a number of unresolved 
research issues. The testbeds are providing a 
large-scale opportunity to test this technology and 
possibly provide iuput to the standards process. 
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The gigabit National Research and Education Network 
(NREN) is to develop from the current Internet, a 
**network of networks" that connects users in all parts 
of the United States and around the worid. The Internet 
allows users to communicate using electronic mail, to retrieve 
data stored in databases, and to access distant computers. The 
network began as an Advanced Research Projects Agency 
research project to investigate computer networidng technology, 
and in sli^tly over 20 years has grown into an essential 
infrastructure for research and education. The NREN initiative 
and associated research programs are intended to support the 
further evolution of research and education networking, broaden- 
ing access to the networit and enabling new {^plications through 
the deployment of advanced technologies. 

Federal support to further the devetopment of networks that 
support research and education communications is directed 
primarily at upgrading the Federal **backbone*' networks that 
have foraied the core of the Internet^ These networks include the 
National Science Foundation's NSFNET backbone, the NASA 
Science Internet (NSI) (figure 2-1), the Department of Energy's 
Energy Sciences Network (ESnet), and the Department of 
Defense's DARTnet and Tferrestriai Wideband Network 
(TWBnet). The NASA and DOE networics are primarily intended 
for traffic related to the mission of the supporting agency, while 
the current NSFNET backbone serves users in a broader range of 
disciplines in universities, supercomputer centers, and industry 
research laboratories. The DOD networks support research and 
development of new communications technologies. The Federal 



Federal agency 
networks will 
form the core 
of the gigabit 
NREN. 
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Figure 2-2'— Regional Network 
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networks are interconnected at FEXes (Federal 
Internet Exchanges) at NASA's Ames Research 
Center in California and at the University of 
Maryland. 

Upgrading the agency-supported backbones is 
not (be only thing needed to improve research and 
education networking. The n^gority of users in 
universities schools, and libraries do not have 
direct access to oae of the backbone networks. 
These users rely on thousands of other networks 
that, together with the Federal agency backbones, 
form the Internet. These networks are intercon- 
nected, and information typically travels through 
several networks on its way from one user to 



another. In order to provide good performance 
end-to-end, all of the Internet's networks will 
need to evolve in a coordinated fashion, matched 
in capability and performance. 

Most of the Internet's networks are * ^campus' ' 
or * ^corporate' ' networks, connecting users within 
a university or a company. Campus and corporate 
networks may in turn be interconnected by 
**regional" networks. For example, NYSERNet 
(New York State Education and Research Net- 
work) connects campuses and industrial custom- 
ers in New York State (figure 2-2) and 
BARRNET (Bay Area Regional Research Net- 
work) does the same in northern California. 
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ngure 2-3— The NSFNET Hierarchical Structure 




SOURCE: National Sd«nc« Foundation (NSF). 



Regional networks also provide a connection 
between campus networks and the national 
NSFNET backbone that carries traffic to other 
regions.^ The regional networks, and he resulting 
three-tier structure of campus, regional, and 
backbone networks (figure 2-3), evolved with 
support from the National Science Foundation.^ 



The Internet also includes several networks 
that provide service on a for-profit basis/ The 
government investment in developing and demon- 
strating Intemet technology during the 1970s and 
1980s has created opportunities for the private 
sector to sell Intemet services. The effectiveness 
of the Internet technology has been proven, and a 
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2 NASA and DOE litet «e connected directly to the agency oetworics. However, NASA and DOE rely on the regional networks and the 
NSFNET bacU)one to conoect to unlvernty rcfeirchen participating in NASA and DOE projecu. 

3 For a detcription of evolution of the regional networks and the tbtee-tier structure, see Richard A. Miodelbaum and Paolette A. 
Mandelbaum, ^'The Strategic I^itnre of the Mid-Level Networks,** Brim iUiin (ed.), BtdUing Information infrastntcturt (New York. NY: 
MoGraw HiU Primis, 1992). 

4 Eric Amaffl, ''Ute Intemet Dilemma: Beeway or ToUway,** Business CommunicaOons Review, December 1992« vol. 22, No. 12, p. 3L 
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growing number of companies are now using the 
Internet to conduct business. Even though the 
NREN program continues government funding 
for the agency backbone networics, in order to 
upgrade them to gigabit speeds, government 
support is becoming less central to the Internet as 
a whole. New commercial providers of nation- 
wide Internet services have emerged. In addition, 
NSF has been reducing subsidies to the regional 
networks, which are increasingly being asked to 
recover costs from users. 

The availability of commercial services is 
leading to a change in the makeup of the users of 
the Intemet. Until recently, corporate xise of the 
Internet was restricted to scientists and engineers 
in research laboratories or engineering depart- 
ments. In part, this was due to the history of the 
Intemet as an experimental network. The limited 
use of the Intemet by the private sector was also 
due to an * 'Acceptable Use** policy that reserved 
the federally supported backbones for research 
and education traffic.^ The new con^mcrr^al 
providers have no traffic restrictions, allowing the 
Incemet to serve a wider range of users. Today's 
Internet users can have different security require- 
ments^ their technical sophisticaaon varies, and 
the demands they place on the nef vork*s capacity 
differs. 

One of the goals of the NREN program is to 
continue the trend towards provision of Intemet 
services on a commercial basis, rather than solely 
as the result of a government subsidy.^ The 
NREN program continues govenmient support 
for networking, but the emergence of commercial 
providers is leading to changes in the mechanisms 
by which this support is provided. NSI and ESnet 



will continue to siqyport agency missions, but the 
next-generation NSFNET backbone will be con- 
siderably different from the current NSFNET 
backbone. As part of its NREN plans, NSF has 
decided that much of die trafBc diat is currently 
carried by its NSFNET backbone will in the 
future be handled by commercial providers, 
encouraging the further development of diis 
segment of the Internet 

The next-generation NSFNET backbone will 
support a narrower range of users and serve fewer 
sites. Today's NSFNET backbone serves many 
sites nationwide, connecting regional networks 
and supercomputer centers (figure 2-4). It is a 
''general purpose'' backbone, carrying traffic 
ranging from ordinary electronic mail to ad- 
vanced supercomputer applications. In the future, 
the backbone will primarily be used by the NSF 
supercomputer centers, in Ithaca, New York, 
Pittsburgh, Pennsylvania, San Diego, California, 
and Chatiq)aign, Illinois.^ Other users, with more 
routine sqjplications, will use services available 
from commercial providers. Without the current 
national backbone, the regional networks will 
have to make new arrangements for their inter- 
connection (see ch. 5, p. 67). 

The next-generation NSFNET backbone will 
continue to contribute to the objective of develop- 
ing advanced networic technology. The new 
backbone, together with the next-generation NSI 
and ESNET, will be one of the first networks to 
use the technologies studied by the gigabit 
testbeds described in ch^ter 4. The Federal 
networks will provide ^'experimental" services, 
not yet available from commercial providers. 
They will demonstrate and test new network 



s For issaes related to NSF*s Acceptable Use Policy, see Hearings before the House Snbcommittee on Sciettce, Space, and Ibchnology, 
Mar. 12, 1992, Serial No. 120. 

« Gary H. Antbes, **Inteniet Security Risks," Computerworld, vol. 26, No. 4S, Nov. 30, 1992, p. 55. 

7 ••[T]bc NREN Program has a scries of synergistic goals [includingl stimulating the availabQity, at a reasonable cost of the required 
services from the private sector,' • Offk« of Science and Tbdm^^ 
A Repoct to Coogreti,** December 1992. p. 2. 

» Foradcacription of thcNSFsupcrcoinptttcrccntcrt, see U.S.Cof«ress, Office of Tfcchiw 
and Networking for Science, OTA-BP-Crr-59 (Washington, DC: U.S. Ciovcmmcnt Printing Office, September 1989), pp. 9-10. 
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Figure 2-4— NSFNET Backbone 




SOURCE: Mtrit Inc. 



technologies and applications before they are 
deployed more widely by operators of commer- 
cial networi{:s. 

Federal agencies may subsidize access to 
network services for users not at one of the 
backbone sites.^ Today, NSF lowers the cost of 
networking for many users by directly subsidiz- 
ing a general-purpose backbone and by providing 
subsidies to the regional networks. This strategy 
has contributed to broadening network access 
beyond major universities and siq>ercomputer 
centers, to include many colleges and schools. In 
the future, many of these users will no longer be 
able to use the subsidized NSF network. Instead, 
Federal agencies may subsidize users* purchases 
of services €rom the commercial providers. 



The NREN can then be viewed as many 
interconnected networks, developing from com- 
ponents of the current Internet, Some networks — 
the agency backbones — ^will be funded directly 
by the government This part of the NREN is 
sometimes referred to as the ' 'Interagency Interim 
NREN** or **NREN proper,** and will use ad- 
vanced network technologies to support high-end 
users, agency missions, and the science objectives 
of the HPCC program. Other Internet networks — 
such as existing regional networks or new com- 
mercial providers — may also carry NREN traffic, 
from users subsidized by the government, but 
would carry commercial traffic as well. These 
networks will likely use less sophisticated network 
technology than the agency backbone networks. 



' ''Overtime, NSF will target its funding to tbosecamposes which have finiiiciai impediments to coonecting into the U.S. Intenet" Robect 
Aiken et al./ *NSF Implementatioa Plan for Interagency Interim NREN/ * May 1992, p. 4; ' 'Federal liinds. . .will also soppon nsen that senre 
Federal miukxis whether or not (hey acceu NREN through the agency netwoifct/* OSTT, op. cit., footnote 7, p. 3. 
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This two-part strategy — ag^ acy operation of 
advanced networks combined with subsidies for 
Internet access for certain groups of end users — 
represents a nioie detailed framework than the 
general NREN concepts and goals outlined in the 
High Pcrfonnance Computing Act of 1991. It is 
expected to form the basis of NSF*s forthcoming 
solicitation for the operation of its component of 
the NREN. It is also outlined in recently intro- 
duced legislation, the High Performance Comput- 
ing and High Speed Networidng Applications Act 
of 1993 (H.R. 1757), which woukl amend the 
High Performance Computing Act of 1991. How- 
ever, diere is concern in parts of the user 
conununity most affected by the change to an 
environment in which there is no longer a general 
purpose government operated network about the 
cost of commercial services and about the timing 
and management of the transition. 

The remainder of this chs^ter describes the 
technology used in the current Internet. Chapter 3 
provides an overview of emerging concepts that 
address some of the limitations of current network 
technology and might be used to construct gigabit 
networks. Ch£q>ter 4 describes the gigabit 
testbeds, NSF- and ARPA-fimded prototype net- 
works that are investigating these new technolo- 
gies. Chapter 5 outlines NSF, NASA, and DOE 
plans for the deployment of the testbed technolo- 
gies in their networks^ 

APPLICATIONS 

Rrom the users* perspective, an ^^application'* 
is a task that the combination of the computer and 
the network enables them to perform. For exam- 
ple, a science teacher might use the Internet to 
locate information that can used in a class, Sf \ch 
as images stored in NASA databases, or databases 
containing tailored educational materials. Research- 
ers use the Internet to track developments in their 
field, by exchanging information or drafts of 
papers .and collaborating with other scientists.^^ 



In the business world, networks are increasiagly 
used to track inventory or manage activities 
diroughout a large conq>any. In the future, nc^t- 
works may be used to help provide medial 
services to distant locations. 

From a network engineering perspective, an 
''application' ' is a computer program that builds 
on the basic network service to allow a user to 
perform tasks. The implication program provides 
interaction with the user; it does not handle the 
details of moving a message through the network 
to its destination. These functions are performed 
by commumcations software — a second program 
running on the computer — and specialized hard- 
ware that converts the computer's digital data to 
the format used by the network* When an 
applications program wants to send information 
to another computer, it hands the message to the 
communications software, which then formats the 
message and sends it over the network. 

There are four major Internet applications — 
electronic mail (e-mail), file transfer, remote 
login, and news. Electronic mail is used to send 
messages to other users of the Internet, and for 
most users it is probably the application they use 
the most frequendy. File transfer (File Transfer 
Protocol or FTP) is used to retrieve a **file'' from 
another computer; a file could be a con:q>uter 
program, an article, or information from a com- 
mercial database. **Remote login'* (Tfclnet) is 
used to control a distant computer, this is the 
application used to access a siq>ncomputer or one 
of the other specialized computing resources on 
the Internet. ''News** is a kind of bulletin board 
or discussion groq) — thousands of ''newsgroiqps'* 
address a wide range of di^rent topics. 

The current Internet applications are diMcult to 
use. For example, it is difficult to find information 
resources on the network. First, the user has to 
know that the information exists son«ewhere 
reachable on the network, then where to find it, 
and, having foimd the database, how to locate the 
information in the database. A number of new 



lopbranovenriewof tbewiderac^of usef forUieItUeniet,S6eD«^ 1992> p. 111. 
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applications assist this process by acting as 
indexes or catalogues. Second, the user inteaface 
for most applications is often difficult to use, 
requiring a user to recall obscure commands. The 
difficulty in use is partly due to the hitemet's 
heritage as an experimental networic used mainly 
by scientists and engineers who were comfortable 
with arcane conqniter languages. 

The existing Internet supplications programs are 
beginning to be replaced by more sophisticated 
versions." Today, for example, the Intemet file 
transfer program, FTP, is used to retrieve a file 
from a distant computer, but a different program 
is used to retrieve a file stored on the *'home'' 
conq>uter. Newer versions of these jqjplications 
are "transparent,'' so that the user will not know 
whether a file is located on a distant con^uter, or 
that a program is executed on a different machine. 
These new applications are the begiimings of a 
foundation for ' 'distributed computing,' ' in which 
the computers on a network form an integrated 
system that performs as a single computer. 

I Applications and Network Technology 

Some limitations of current applications are 
due to the applications software itself, but other 
limitations are due to the underlying network 
technology. One problem with current network 
technology is a shortage of bandwidth. Band* 
width is a measure of the amount of data that can 
be moved through the network in a given period 
of time, and is typically specified in terms of "bits 
per second." Because of the limited cj^acity of 
today's network, it is often impractical to move 
large amounts of data across the network — 
exan^les of large files are images (see box 2-A) 
and the data sets used in supercomputer applica- 
tions. 



A second limitation of current Internet technol* 
ogy is that it is best suited for applications that 
handle text or numerical data. The Intemet is less 
effective when supporting applications that make 
use of ''real*time" media such as video and 
sound.^^ In the case of video, this is due in part to 
the baxKiwidth limitation— hi^-quality video needs 
to move large amounts of data, and the necessary 
bandwidth is not available throughout the In- 
ternet Support for video and sound is also limited 
because the performance of the Intemet is highly 
variable. Because video creates the illusion of 
motion by f^snding a ** stream" of pictures at 
regular intervals, a longer delay in the time it 
takes one of the pictures to get through the 
network irterrupts the video information that is 
being displayed on the user's computcr.^^ A new 
techno!og!' called **fast packet switching," dis- 
cussed in detail in chsqpter 3, may provide the 
more consistent networic performance that video 
{plications need. Digital transmission and high 
bandwidth alone are not always sufficient to 
enable a network to carry video. 

The limited C2^acity of the current Intemet and 
the variability of its performance also constrain 
the use of sophisticated ' 'distributed confuting' ' 
^plications. In distributed computing, one is able 
to treat the computers on a netwoiic as a single, 
more powerful computer. For exan^le, two 
computers, exchanging data through the network 
as necessary, might be able to con^>lete a 
conq>utation ia half the time needed by one 
computer working alone. If data takes too long to 
travel between the computers, however, the 
advantages of dividing a compu^on among 
several computers are lost In the current hitemet, 
the local area network (LAN) technology used in 
campus networks often performs better than wide 
area network (WAN) technology used in the 



i» Fbr e3ttmplc '•distribnied fUc lyitani** arc begiiming to replace the tnditioful File Tnntfer Protocol (FTP) i|)pUcaUoa. 

J2 Jefi&ey Schwim, "A Push for Picket Video/* ComFtmmamonsWttk, Aug. 3. 1992, p. 1. 

i3TbUproblemUbcin§att«*cdinaiuimber<rfw«ys.Ncwiict^ 
innctwor perfomumce. Other leseTcfam are invettigating mcchwignt that would compcpttc for the virUble pqfonMacc. Fbf exiinple, 
the lecetviiig computer could ''even out*' some of the variatioa before the dau is dispUycd to the user. 
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Box 2-A-4mages and Video 

Images 

The taeen d a computer's display Is made up of many individual picture elements or "pixels," like the little 
dots that can t)e seen on television saeens. By displaying each pixel with a differert shade and different color, 
the computer forms an Image on the screea The greater the density of pixels, the higher the "resolution" of the 
Image. Ih^ displays used for ordinary desktop computers usually have a tow hundred pixels In both the horizontal 
and vertical dlrecttons.wNleahlghKjefinltk)ntelevisk)ndlSiTla^ 

2.000 horiaxitaHy. Even hl^ resolutton displays are Mnj devetoped for spedaliimJ medkad. publishing, and 

detonse^eiated appik^atkm. 

The use oihHjh-resoiutton images places consklerai^s demands on com^ 
pixel onasaeen is represented by 24 bits.Ahigh-resolutk)n display with 2.^ 
vertkallyhas4miilkxi pixels (2.000xa000-4m000). This meansthat96miHk^ 

the image (4 miUkm x 24 - 96 milKon). 

In tho telephone network, vok» conversattons are sent through links that transmit 64 thousand bits per 
second Using these links, an image represented by 96 million bits wouW take 25 minutes to send through the 
network. By contrast, it wouM take less than one-tenth of a second to send the same Image through a gigabit 
network. 

Video 

VWeo is a series of Images, sent many times a second at regular Intervals In order to create the iiluskxi of 
motkxi. Typically. 30 or 60 Images are sent every second, in a tow bandwkith network, in order to send this many 
Images every second, the Images have to be of very tow resokitton. 

Two strategies have been adopted for accommodating image and vWeo transport In networks. The first Is 
to use con^irBssion technk^ues that reduce the number of bits needed for each image. Often, some parts of a 
scene do not have to be shown in great detail. Compresston schemes for vWeotetephones sometimes rely on the 
factthat users are only interested in the "talking head." not the background. Sometimes little changes from one 
image to the next (If there is no movement in the scene), in whtoh case the Image data does not need to be sent 
again. 

These technkjues are being applied to the new high-definitton televiston systems that are being studtod by 
the Federal Communkattons Commisston for selectton as a U.S. standard. An uncompressed hIgh-definitton 
televiston signal that sends 30 Images or "frames" every second, with a resolutton of 1 .000 pixels verttoaMy and 
2.000 pixels horizontally, needs about 1 ,5 gigabits per second. By contrast, new compresston algorithms support 
high-definitton televiston at bandwkfths o( 30 Wol% or less, one-fiftieth the bandwWth required for the 
uncompressed signal. 

The second strategy for accommodating vkteo or images Is to Inaease networic capacity. Fiber optto 
technotogy can transport many more bits every second than the 'twisted pair^ copper wires that are used for 
toda/s tetophone servtoe. TWs background paper outlines sorne of the research being 
networks that can carry high-resdutton video and Images. However, even a "gigabit network" Is not suff totont for 
certain kinds of very high-resdutton vtoeo. and compresston technk)ues might stIM be used. 

SOUaCES: P»oo H. Ang -VWto ComprMtion MakM Big Q^km: tEEBSp^drvm, vd. 2S, No. 10. October 1W1 . PP- 

C<M, "Th# Technotogy fmrmtotkr IBBB Sp^dnjm, vol. 30, No. 3. March 1 W3, pp. 32^S: J. Bryan LyiM and DtnM C. Swinohart ^ha 

Emargbg Gigabit Envifonmwrt and tha Rola ol U>cal klUT IEEE CommunictMom, vol. 30. No. 4, April 1902. pp. 52.5S. 
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Figure 2-5-Growth In NSFNET Traffic 




SOURCE: M«ht Inc. 

regionai and national backbone networks and thus 
distributed computing sqpplicadons are used more 
widely in the local environment. 

Limitations in netwoik perfomiance are be- 
coming more parent as computer technology 
advances. First, advances in computer power 
have resulted in demands for more bandwidth 
(figure 2-5). The size of the files that users would 
like to send through the network is increasing as 
a result of greater processing power and larger 
memories.^^ Some of the new **massiveiy paral- 
lel' ' computers being studied as part of the HPCC 
Program may accelerate this trend (sec box 2-B). 
Furthermore, the declining cost of confuting 
power has allowed more users to cotmect to the 
network, creating more demand for the Umited 
amount of capacity. Second, computers are 
increasingly equipped with display technology 
that supports video-based applications. As video 
and sound begin to be processed by computers, 
there will be greater demand for networks that 
support this stream-type traffic. Today's net- 



works were designed for an environment in which 
conq)utas were restricted to woddng with ordi- 
nary text and numerical data. 

hi response to the limitations of today's net- 
works and the trends in computer design, there is 
now a general vision of the type of services that 
future conq>uter networks will have to support — 
larger, possibly image-oriented files, greater use 
of stream-type services such as video and sound, 
and more distributed computing. However, there 
are a number of issues that must be solved, and 
researchers are trying to learn more about the 
implications that users will need in the future. 
Because most network technologies support some 
types of £^lications better than others, argu- 
ments in the technical conununity about the best 
way to build broadband networks can often be 
traced to different assumptions about the ex- 
pected niix of applications* One of the objectives 
of the NSF/ARPA gigabit testbeds discussed in 
chapter 4 is to learn about applications for 
advanced networks by encouraging collaboration 
among {^plications developers and network engi- 
neers. 

PROTOCOLS 

The Internet is a * *packct-switched' ' network — 
a very different design from that used by the 
telephone network,^^ Data travels through the 
network as a "packet," a block of digital data 
consisting of the iq)plication's data and some 
extra information added by the communications 
software and hardware.^'^ This information is sent 
either before the q>plications data in a ' 'header," 
or after the data, in a ''trailer," and tells the 
network the packet's destination address or in- 
structs the receiving computer as to what to do 
with the applications data in the packet (figure 
2-6). For example, the sending computer could 



u Tim studt, * *Caa Higji-Perfonaaace Networks Meel Future RAD Needs?** Magazine, October 1992, pp. 30-34. 
1^ Traffic on the NSFNET teckboiie is growing at a rate of 10% per month. OSTP, op. cit., footnote 7, p. 31. 
u Vinton G. Cerf, '*Networlcs,** Sdendfic American, vol 265, No. 3, September 1991, pp. 72-81. 
17 Often, packets are compared to the eoYdopes used in ocdinacy mail service-^ 
function as the addreu on an okvetope. 
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Box 2-B--Ma$siveiy Parallel Computers 

Tha oonventiona] computers found on most dssktops uss a single processor. Programs for these computers 
consist of a list of instaictions, to be executed one after another bf the processa. Parallel computers are t>88ed 
on the idea thataoomputerwiith several processors can soiveaprobim 

processor. Much of the HPCC Program's supercomputer design research focuses on the development of 
''massively paralleT computers with thousands of processors. 

Supercomputers are expensive, hl(^*performance machines that have been used mair4y for numerical 
simulations in sdence and ergineering. The first oommercialty important superoomputer, the CRAY-1 , was first 
sold in 197& It used a sinclto processa, and achieved its high perfornriam 
and the use of specialized electronics. Over the next decade, supercomputer desH)^ 
trying to achieve the highest possible performance with a single processor. 

By the mid-1980s, however, it became increasingly difficult to squeeze better perfbrmance out of traditional 
superoomputer designs, even as more exotic technologies were applied to the task. As a result supercomputer 
designers began trying a different route to improved performance-the use of several processors. One approach 
involved a relatively small number of traditional high-perfamance supercomputer processors. Fbr example, in 
1963, Cray shipped a supercomputer that used four processors to speed up performance. 

By contrast, the massively parallel approach to supercomputer design uses hundreds or thousands of 
low-cost miaoprocessors (processors that fit on a single semiconductor chip). The greater the number of 
processas, the more powerful the computer. In many cases, the microprocessors are the same as those used 
in high-end workstations. The performance of mkxoprocessors increases every year, aeating the potential for 
even more powerful massively paraHel supercomputers. 

Supercomputer centers and Federal taboratories have purchased several massively paralel siq)ercomputers 
and are exploring their use in a number of applicatk>ns. A major challenge for users of masstvety parallel 
supercomputers lies in the area of software. Massively parallel computers have to be programmed in new ways, 
because programs can no longer be thought of as a simple list of instmctions. New algorithms, efficient ways of 
solving numerical problems, will have to be developed. Research on algorithms and software tools that take 
advantage of the potential of massively parallel supercomputers is one focus of the HPCC program. 

SOURCES: Qltnn Zexpttt*. •d^ ''SfMdtl Rtport Sup^roomputtrt*" IEEE Sp^drm, vol. 29, No. 9, Soptombor 1992; pp. 2S-41 ; Offk» 
of Sd^nct and Ttchnoiogy Policy, "Grand ChaSongM 1993: H^h P«fform«(K» Computing and Communiottiontr 1992, pp. 13-17; Cart 
S. Udbottor, "A HMorical Ptrtp«Cjvo of Sdontiflc Computing in Japan and tha Unltad SUtaa/' Svpmeomputing RBvhmt, vol. 3, No. 1 2, 
Dacambar 1990, pp. 4S-5S. 



put a short code in the header to tell the receiving 
computer that the data belongs to an electronic 
mail message — this allows the receiving com- 
puter to process the data appropriately after 
receiving the packet. 

Once the packets have been formatted they are 
sent out of the computer and through the net- 
work's web of links and switches. Switches 
receive packets coming in on one link and send 
them out on the next link in the path to their 
destination (figure 2-7), When the packet arrives 
at a switch, the switch scans the destination 



address and determines which link the packet 
should transit next. The Intemet packet switches 
or * 'routers' ' are special computers that have been 
provided with connections to a number of links 
and programmed to carry out the switching 
functions. 

The software in the routers and the users' 
computers implement ''protocols," the rules that 
determine the format of the packets and the 
actions taken by the routers and networked 
computers. The Intemet protocols are often re- 
ferred to as TCP/IP (the acronyms refer to the two 
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Figure 2-6~-Packet 



Trailer 



Applications data 



Header 

To: Computer #- 
From: Computer #- 



A packet is a block of digital data, consisting of data from the user's application and extra informationused by the network 
or receiving computer to process the packet For example, the "header" might contain the "address" of the destination 
computer. A real packet wouW be several thousand bits long. 



SOURCE: Offic* of T«Ghno(ogy AM«Mm«nt. 1993. 



most waportsini Internet protocols, the Transmis- 
sion Control Protocol and the Intemet Protocol.) 
Special protocols called "routing protocols*' are 
used by the routers to keep a current m2^ of the 
Intanet and to determine the best path to a 
destination computer — for example, to choose a 
path that avoids heavily loaded networks. 

One of the most important characteristics of the 
Intemet is that the thousands of linked networks 
are independently operated; there is no central 
control of the Intemet. However, by sharing the 
Intemet protocols, the networics are able to 
exchange traffic. One of the functions of the 
Intemet protocols is to mask differences in the 
technology used by the networks that make up the 
Intemet. The campus networks* local area net- 
work technology differs from the wide area 
network technology used in the regional and 
national backbone networks, and there are many 
different local area network standards. The term 
**Intemet*' is short for "intemetworking,** the 
practice of linking technologically different and 
independently operated networks. 

The future of the current Intemet protocols is 
the subject of considerable debate in the Intemet 
community. The most significant problem is that 
today's routing technologies are being strained by 
rapid growth in the number of connected net* 
wo^ and users.^^ The management of acomplex 
and growing network has been one of the major 
challenges faced by the current NSFNET. A 



number of different proposals that would simplify 
the routers' task of finding paths through today's 
more complex Intemet are being considered. The 
effect of increases in bandwidth on TCP/IP has 
also been debated in the technical community, 
and new protocols have been proposed. Many 
now believe that TCP/IP can continue to provide 
good service over gigabit networks, but internet- 
working in high bandwidth networks is a research 
topic in itself. 

NETWORK COMPONENTS 

A network is a complex system, consisting of 
many computer programs and hardware compo- 
nents such as links, conq>uters, and switches. The 
overall performance of the network depends on 
how well these components work together. There 
are a number of potential bottlenecks — the rate at 
which data can be transferred from the computer' s 
memory to the network, the rate at which data can 
be transmitted through the links, and the amount 
of time the switches need to decide where to send 
data next. Simply removing one of these bottle- 
necks does not guarantee that the overall perform- 
ance of the network will improve. The emergence 
of fiber optics has removed the links as a 
bottleneck for the foreseeable future; the research 
projects described in chapter 4 show that this has 
exposed research issues in other parts of the 
network. 



Karen Lynch, **IiitefnetMeiiiiiocphoiii/* CommunicatioruWeek International. Avi%, 10, 1992. p. 1. 
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Figure 2«7*-Packet Switching 
(a) Pack«t<switched communication 




As a packet travels through the network, the switches deckle where to send the packet next. 
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(b) Single link shared by several users 



The links in a packet network are shared by several users. Network designers choose 
the link capacity or bandwkith to match the expected arrwunt of traff ki. 




SOURCE: Off to* of TMhnotopy AstMsmwit. 1993. 

I Computers 

Many different kinds of computers are attached 
to the Internet, ranging from desktop personal 
computers costing a few hundred dollars to 
supercomputers that cost millions of dollars. 
Among scientists and engineers, the type of 
conq>uter that is most widely used is the work- 
station/* a powerful desktop con:q)uter with 
enough processing power to support graphical 



user interfaces and high-resolution displays. For 
most of today's sqyplicadons, almost any com- 
puter has enough processing power to attach to 
the Intemet. The low bandwidth of the current 
Internet places few demands on computers for 
handling the commtinications functions, leaving 
much of the processing power £tee to run the 
applications. 
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One of the reasons for the creation of the 
NSFNET backbone was to provide access to 
NSF*s four supercomputer centers. Recently, 
these supercomputer centers have begun to install 
** massively paraller* supercomputers. This new 
type of supercomputer attenq)ts to achieve very 
high processing speeds by combining the process- 
ing power of thousands of smaller processors. 
Other supercomputers use a more traditional 
design, and are referred to as **vector** supercom- 
puters. Each design may work best with certain 
kinds of computations; one of the objectives of 
the gigabit testbed research is to explore the use 
of networks to divide up problems in a way that 
takes advantage of the strengths of both vector 
and massively parallel supercomputers.^^ 

I Links 

The digital links in computer networks usually 
use copper or fiber, but satellite and microwave 
link<g are also used. At each end of the copper or 
fiber is the transmission equipment, electronics 
that convert data into the optical or electrical 
signals that travel through the network. The 
capacity of the wires or strands of fiber depends 
on the characteristics of the material used and on 
the capabilities of the transmission equipment. 

Today *s Internet uses both low bandwidth links 
that operate over copper at a few thousand bits per 
second (kilobits per second or kb/s), and high 
bandwidth links that operate over fiber with a data 
rate of about 45 million bits per second (megabits 
per second or Mb/s). The test networks described 
in chapter 4 will use links that operate at a rate of 
one billion bits per second (a gigabit per second 
or Gb/s). 

Typically, a single wire or strand of fiber 
carries many links at the same time. Through a 
process called ^^multiplexing,** several low- 
bandwidth links can be aggregaved into a higher 
bandwidth link. Gigabit-cs^acity fiber, for exam- 
ple, can be used either to carry several thousand 



low-bandwidth links used for telephone calls, or 
a single high-bandwidth link needed for a gigabit 
network. 

The required link bandwidth depends on both 
the bandwidth requirement of each user and on 
the numbo: of users sharing the link. One of the 
main reasons for upgrading the links in the 
NSFNET backbone firom 1.5 Mb/s to 45 Mb/s in 
1991 was to accommodate growth in the number 
of users. Growth in the use of routine applications 
can also be supported by simply adding more 
low-bandwidth links. However, new applications 
that need very large amoimts of bandwidth to 
themselves require the deployment of higher 
bandwidth links. By increasing the link band- 
width to gigabit rates, the gigabit NREN will be 
able to support new classes of advanced applica- 
tions, not just growth in the number of users. 

Operators of wide area computer networks, 
such as the regional networks and the agency 
backbones, typically lease their links from the 
telephone companies. The telephone companies 
have already obtained the rigjits-of-way and have 
installed the transmission facilities for use in their 
core business, voice telephone service. Because 
of the reliance on telephone company facilities, 
discussions of computer network link bandwidth 
often use telecommunications industry designa- 
tions of link capacity. For example, the current 
NSFNET backbone is often refcned to as a * *T3* * 
network, after the industry designation of 45 Mb/s 
links. **Tr' links, which operate at 1.5 Mb/s, are 
used in the current Department of Energy and 
NASA networks and in the regional networks. As 
the Federal networks are upgraded to bandwidths 
above the 45 Mb/s T3 rate, they will use a new 
family of transmission standards designed for 
high-capacity fiber optic links, called Synchro- 
nous Optical Network (SONET) (see table 2-1). 

Universities and corporations install their own 
links in their buildings for use in local area 
networks. Local area networks can provide users 
with higher bandwidth than wide area networks — 



^9 "A Union of Supcipowcn/* IEEE Spectrum, vol. 28. No. 6. June 1991. p. 18. 
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Figure 2-e— Access Link 




SOURCE: Off b« of Technology AtMMmwit 1993. 



Table 2-1— Transmission Rates 



Industry designation 


Transmission rate 




64Mb/s 




1.5Mh/s 




45 Mh/s 




155MIVS 




622MIVS 




2.4Gb/s 



SOURCE: Off ioo of Toohnology AsMMmcnt, 1993. 

this is due in large part to the high cost of high 
bandwidth wide area links. Because of the higher 
bandwidth available on local area networks, they 
have been used for experimentation with high- 
bandwidth distributed computing and video im- 
plications. In the future, however, users will want 
wide area networks that match the performance of 
local area networics; one of the objectives of the 
testbed project outlined in chapter 4 is to investi- 
gate high-spi'ed wide area networking. 

When campus networks arrange to be con- 
nected to the closest regional or national network, 
they obtain an **access" link (figure 2-8). This is 
usually leased from the telephone company, just 
as the hnks inside wide area networks are leased 
from the telephone company. The cost of the 
Internet service depends on the access bandwidth; 
high bandwidth access is extremely expensive. It 
is conunon to find local area networks operating 
at 10 Mb/s or 100 Mb/s, while the access link to 
the rest of the Internet operates at 56 kb/s or less 
(some organizations have 1.5 Mb/s access links, 
but these are considerably more expensive). Most 



individuals, schools, and small businesses are 
required to use their ordinary analog telephone 
line to access Internet services — a device called a 
"modem'* is needed to send digital computer 
data o\cr these lines, usually at 14.4 kb/s or less. 

I Switches 

Packet switches in the Internet, also known as 
routers, direct packets to the next link in the path 
to their destination. Packet switched networks 
emerged to handle data conmiunications, services 
not well supported by the * ^circuit switches' ' us^ 
for ordinary telephone calls (figure 2-9). Packet 
networks are more efficient for typical con^)uter 
communications traffic — short transactions or 
**bursts'* separated by periods of no traffic (box 
2-C). In a packet network, several users share the 
same link--<iuring the period in which one group 
of users is not using the link, other users can send 
their packets. In a circuit switched network, by 
contrast, each conmiunication gets its own link. 
For this reason, circuit switches are most efficient 
when a communication involves a relatively long, 
steady stream of data such as video or voice. 

While the Intemet networks use telephone 
coit^any links, the packet switches are usually 
not operated by the telephone companies. Instead, 
a second organization plans the network and 
installs the packet switches at the sites it has 
chosen — the involvement of the telephone com* 
pany is usually limited to providing the links 
between the sites. From the perspective of the 
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Figure 2-9^ircuit Switching 
(a) Telephone network 



Circuit switch 



in the telephone network, circuit switches are interconnected by several links. 
No communication can take place until a "circuit" is established. 





(b) Circuit-switched call 



First, a number is dialled by one of the users. The network then checks to make 
sure that there are unused links in the path between the two users. If there are 
unused links, the switches establish connections between each of the links In the 
path, thereby creating a "circuit." 




(c) Separate circuits for each call 




The links in a circuit are reserved for users until they "hang up." A new circuit 
has to be established for each pair of users. Network designers try to ensure 
that the number of available links matches the expected level of usage. 



SOURCE: Off IM of T«QhrK>looy AM#Mm«m, 1093. 
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telephone coiapany^ the computer network traffic 
is just **bits** traveling over its links— the tele- 
phone company's equipment does not make 
decisions about where to send the packets. 
Beginning in the mid- 1970$, the telephone com- 
panies began installing some padcet switches in 
their networks in order to support the growing 
data communications market, but their efforts to 
enter this maiket were considered to be unsuc- 
cessful* 

Hie processing power required of a packet 
switch depends on the link bandwidth and the 
complexity of the network. As the link bandwidth 
increases, switches must be able to process 
packets more quickly. The processing power 
needed will also increase as the network gets 
larger and more complex, because it becomes 
more difficult to determine the best path through 
the netwo^* Currently, the NSFNET bacldxHie's 
router technology does not allow the use of 
{plications that need more than 22.5 Mb/s, half 
the potential maximum of a 45 Mb/s T3 net- 
work.^ This shows how the overall performance 
of the network depends on many differec; compo- 
nents; increasing the link bandwidth is not the 
only requirement for an advanced network. 

THE INTERNET AND THE PUBLIC 
SWITCHED NETWORK 

In some ways, the Intemet and the ''public 
switched network'' that is operated by common 
carrier telephone companies are separate* They 
differ in the slices they provide — the telephone 
network mainly provides ordinary voice cormnu- 
nications services, while the Intemet provides 
data communications services such as electronic 
mail and access to remote computers. They also 
differ as to the communities that they serve — 
almost everyone has a telephone, while the 
Intemet ?jcd other computer networks primarily 
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serve users in the academic conmxunity or in 
industry. Fmally, they differ in their network 
technology — the Intemet is a packet-switched 
network, while the telephone networic: is a circuit- 
switched network. However, the Internet and the 
telephone netwodc are related in a number of 
ways. Any discussion of the evolution of net- 
working has to consider both the traditional 
telecommunications companies and the Intemet 
conununity. 

First, the Intemet and the public switched 
network are related in that the links in wide-area 
computer networks are usually supplied by the 
telephone companies — computer network opera- 
tors do not usually put their own fiber in the 
ground. As a result, the availability of new 
con^uter network c^abUities can depend on the 
extent to which the tel^hone companies deploy 
advanced transmission facilities, and on the cost 
of leasing the linkjs. 

The availability of advanced transmission fa- 
cilities varies^S dq>ending on whether a com- 
puter network will operate over the telephone 
network*s **interoffice** or **local loop** seg- 
ments. Most of the links required for a wide area 
network such as the NSFNET backbone operate 
over the interoffice core of the telephone networic, 
which has largely been upgraded to optical fiber 
and digital transmission. The telephone compa- 
nies upgraded this part of their networks in part to 
achieve operational savings, even when deliver- 
ing existing sovices* 

However, access links, such as those between 
a can^)us and a regional network, need to use 
local loop facilities. For the nK>st part, this 
segment of the telephone network still consists of 
copper, analog Unes. Large users are able to avoid 
this bottleneck by making special arrangements 
with the local exchange carrier for higher band- 
width digital lines. However, individuals, 
schools, and small businesses generally have to 



30 AlftD Bvitz, IBM penooal commnniciliofl, Feb. 3t 1993. 

21 Nitknal TUecomnuiiiicaiiofis and Infonnatioii AdminittnUioQ, r)epartiiieiit of Commerce* ^'Iblecommuucatioac in the Age of 
Infonnatkn,** October 1991, pp. 97-109. 
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Box 2-C— Packet Switching and Circuit Switching 

Computer networks such as the Internet use packet switches* which direct packets from link to link through 
a network. Toda/s telephone network, t>y contrast, uses circuit switches. Each type of switching technok)gy works 
best with different kinds of conwnurtcatkMw. Packet switching is more effkaentforthe transferoftypkai computer 
communkattens traff te such as files of text or numerical data (figure 2-C-1 ). Circuit switching, on the other hand. 



Figure Packet Switching More Efficient for Data 

(a) Data communicaUons does not use circuits fuUy 




Circuit switching can be used for computer communications. Here, circuits have been set up between two pairs 
of computers. However, computer communications often have a "bursty" character ~ periods in which data is 
sent followed by periods of "silence." When no data is sent, the circuit's capacity goes unused. The capacity is 
used more efficiently when the communications involve a steady flow of information, such as video 
or voice transmission. 



(b) Link sharing makes packet networks more efficient for data 




II II 




In a packet-switched network, several users' traffic shares the same link. If one user is not using the link's 
capacity, it can be used by others. The figure shows bursts of data assembled into packets and travelling 
through the network on the same link. Here, one link's capacity is sufficient to handle communications between 
both pairs of users, freeing the second link for other uses. 

SOURCE: Offk» of Technology As**Mm#nt, 1993. 



use the combination of a modem and their 
telephone line to access computer networks. The 
bandwidth of such an arrangement is relatively 
low— only a few kb/s — and is clearly a bottleneck 
that limits widespread use of sophisticated serv- 
ices. 

The telephone network and computer networks 
are also related in the sense that the traditional 



telecommunications providers are beginning to 
offer data communications services, including 
Internet services. In the past, efforts by the 
industry to enter this market have not been 
successful. This has been attributed to a "culture 
clash" — a lack of understanding of computer 
network technology and of the needs of users of 
computer networks. However, the telephone com- 
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can pcovicte the conaWent p#ribrmafK» nee^ 
tte r*«MVCh described i n chapter 3 and 

of packet switchino with the consistent performance of circuit switcNng. 



Rgure 2-C-2— Circuit Switching Better for Voice or Video 



(a) Variable performance due to packet network Unk sharing 




If two packets arrive at a switch at the same time and need to use the same outgoing link (t), one of the packets 
will have to wait (ii). It is difficult for a user to know in advance what the network performance will be. The 
packet may experience no delay (the dark gray packet), or it may have to wait at each switch (the light gray 
packet). This variation in delay has limited the use of packet networks for time-sensitive communicatk)ns such 
as video or voice. 



(b) Circuit switched performance is predictable 




(I) 




(il) 



In a circuit-switched network, each communication has its own circuit. Users' information travels through the 
network without being affected by the characteristics of other communications (i)-(ii). The time needed for 
information to travel through the network will always be the same. 

SOURCE: OffiM of Technology AsMtsnwnt. 1993. 



panies hope to play a more active role in this 
market. 

The telephone companies have two main com- 
petitors in this venture. First, there are already a 
number of commercial providers of Internet 
services and other data communications services. 
These providers lease lines from the telephone 
companies, install packet switches, and operate 



their network without any further involvement 
from the telephone companies, sharing then- 
network* s capacity among different groups of 
users for a fee. Ihe current T3 NSFNET backbone 
is obtained as a service from one of these 
commercial Internet providers. 

Second, many users choose to operate * *private 
networks'* — they build a networic of their own 
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using leased lines and bypass the public netwoik. 
Most corporations use this strategy to intercon- 
nect local area networics at different sites within 
their organization. Equipment used in private 
networks is provided by con4>uter companies and 
others, who have taken advantage of the tele** 
phone conq>anies' lack of success in providing 
data communications services. United States 
firms that specialize in the development of routers 
and other equipment for private netwoiks are 
world leaders and are among today's fastest 
growing companies.^ 

The telephone companies have introduced a 
number of new packet-switched services that are 
intenderl to encourage users to abandon their 
private networks.^ One of these services is called 
Switched Multimegabit Data Service (SMDS); 
another is called Frame Relay The SMDS and 
Frmit Relay switches do not imderstand the 
Intemet protocols, but they can still be used to 
carry Intemet traffic. The Ihtemct packets arc 
' *enc^sulated/ ' or put inside an SMDS or Frame 
Relay * ^envelope/ * and sent through the network; 
at the other end the Intemet packet is extracted 
and delivered to the computer. The carriers view 
SMDS and Frame Relay as transitional steps to a 
new technology called Asynchronous Transfer 
Mode (ATM), described in chapter 3. They can 
potentially be used to provide data communica- 
tions services up to 45 Mb/s. 

Because of the interrelationship between the 
Intemet and the public switched network, the 



evolution of the Intemet is affected by two 
different sets of standards committees. The tele- 
communications iodustry standards affect mainly 
low level issues, such as transmission standards, 
but some of the standards for new telecommuni- 
cations industry packet switched services may 
play a role as weiL The most important interna- 
tional standards group is L:e CXTFT (Mema- 
tional Iblegraph and Iblephone Consultative 
Committee). The CCTTT is a technical committee 
of the International Iblecommunications Union 
(mi), a specialized agency of the United Nations 
that is headquartered in Geneva*^ United States 
telecommunications standards are the responsi- 
bility of Committee Tl , which is accredited by the 
American National Standards Institute (ANSI) 
and sponsored by the Exchange Carriers Stand- 
ards Association (ECSA).^ Ifelecommunications 
industry standards setting has often been criti- 
cized as excessively bureaucratic and slow. 

By contrast, the Intemet standards community, 
which addresses higher level issues related to 
routing, the TCP/IP protocols, and s^lications, is 
more informal. Much of the woric is done by 
electronic mail, and there is a greater en[q)hasis on 
proving that something works before it is stand- 
ardized.^^ The two groups responsible for Intemet 
standards are the Intemet Engineering Task Force 
(IETF) and the Intemet Activities Board (lAB). 
The IETF has a number of different working 
groups, each looking at a different aspect of the 
Internet's operation. 



22 G. Pascal Zachaiy, "U.S. High-lfcch Finns Have Begun SUging Littlc-Noticcd Revivil/* Wall Street Journal, Dec. 14, 1992, p. 1; G. 
Pascal Zachtty and Stephen Kteider Yoder, ''Compoter Industry Divides Into Camps of Wimien and Losen,** JaiL 27, 1993, p. 1; Alan 
Dentschman, *'Afflerica*s Fastest-<3rowing Companies,** Fortune, vol., 126, No. 7, Oct 5, 1992, p. 58. 

^ Anotber maiket for these services is the smaller companies that caonot cuTeotly justify private networks. 

24 xim Wilson, ''Local Carriers Lay Out DaU Service Agendas,'* CommunicationsWeek, May 25, 1992. 

25 GJV. Codding and A.M. Rutkowski, The International Telecommuucations Union in a Changing World (Dedham, MA: Aitech Hoase, 

1982). 

26 1.M, Lifchus, "Standards Committee Tl — ^Iblecommantcations,** IEEE Communications, vol. 23, No. 1, January 1985, pp. 34-37. 
27 Carl Malamud, "Stacks: Interoperability in Tbday*s Computer Networks,** (Englewood CUfis, NJ: Preniice Hall, 1992), p. 223. 
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Advances in computer technology are driving the require- 
ments for broadband networks. Because of increases in 
the processing power of computers, there is a need for 
higher bandwidth netwoijcs. Computers are increasingly 
able to execute ' 'multimedia' ' applications, so it is expected that 
future networks must be able to carry several kinds of traffic. 
Broadband networks will lead to s^plications that are used for a 
wider range of problems, with more emphasis on image-based 
communications. 

The computer and telecommunications industries have con- 
ceived broadband network designs for these requirements. Fiber 
optic links are a key component of these networks. However, 
replacing the smaller capmty links in ctirrent networks with 
higher bandwidth fiber optic links is not all that is needed: 
Improvements in protocol and switch design must also follow. 
Future switches will have more processing power, in order to 
keep pace with the faster flow of traffic through the links. They 
will also be designed in a way that allows them to handle 
different types of traffic. Tbday's switching technologies do not 
have this csq[>ability — packet switches only handle text and 
numerical data efficiently, the telephone networic's circuit 
switches are best suited to voice traffic, and special networks are 
needed for video. The ''integrated services** concept envisions 
networks that use the same links and switches for all types of 
traffic, instead of different technologies for video, data, and 
voice. 

BROADBAND APPUCATIONS 

The new high bandwidtfi integrated services networks would 
improve the poformance of existing plications and enable new 
applications. Existing applications, such as electronic mail or 
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databases, could be augmented through the use of 
image files and video clips; hi^er bandwidth 
networks would also aHow die faster transfer of 
large files of superoMx^mter data. Support for 
real-time high-resolution video would expand 
possibilities further, allowing videoc<^e]:encing 
or the display of output from a scientific instru- 
ment, such as a telescope. More generally, the 
combination of caore powerful computers and 
integrated services netwoxks will pemiit wider 
use of two new categories of applications — 
multimedia s^lications and distributed comput- 
ing. 

I Multimedia Applications 

Multimedia applications take advantage of the 
caq)ability of high-bandwidth iategiated services 
networks to deliver many different kinds of 
data — ^video, image, audio, and text and numeri- 
cal data. They also take advantage of the process- 
ing power of advanced workstations and other 
devices attached to the network, allowing users to 
edit, process, and select data arriving from a 
variety of sources over the network.^ Multimedia 
^plications have been suggested for a large 
number of areas^ including education and health 
care. Tliere are many different concepts for 
delivering multimedia services to the home, such 
as multimedia catalogues for home shopping, 
information services, entertainment video, and 
videotelephone services. Many segments of both 
service and manufacturing industries are increas- 
ingly using image-based q)plications — ^for exam- 
ple, computers are widely used in the publishing 
and advertising industries to con^se pages 
using high-resolution images. 

Multimedia is also the foundation for a new 
category of applications that use the combination 



of computing and communications to create a 
''collaborative'' work envir<»iment in which 
users at a number of scattered sites are able to 
woidk together on die same project^ For exanq>le, 
an application might allow several researchers to 
wotk. cm the same set of expoimental data at the 
same time — any processing done by one re- 
searcher would automatically be shown 'Xi the 
odier researchers' displays. Videoconfoencing 
and collaborative s^lications mi^ allow clos^ 
interaction between researchers in different places. 
It is expected, for example, that the teams 
working on the Grand Challenges will include 
scientists at many locations. 

For researchers, "visualization" provides a 
way to represent large amounts of data in a more 
understandable fonn; it uses images and video to 
show the results of simulations or experiments^ 
(box 3-A). For example, die results of a simula- 
tion of a city's air quality could be shown as an 
image, with the concentration of a particular 
chemical indicated by different colors and color 
intensity. If a researcher wanted to review the 
evolution of the air quality over time, a series of 
images could be used to create a video segment 
showing the change in pollutant concentration. 
Other programs running on the workstation could 
be used to process the data further, pertiaps by 
examining one part of an image more closely or 
by comparing the simulation data to experimental 
data. 

In education, multimedia could be xised in 
conq)Uter-based instructional materials. Multi- 
media databases would give students and teachers 
access to image aiul video data. Videoconfer- 
encing and collaborative applications could ena- 
ble closer interaction between teachers and sm- 
dents at multiple locations. For exan^le, it might 



1 Special Isioe: MiiItimMliA CooamiiucatioDS, IEEE Communications, vol. 30, No. 5, May 1992. 

2 Michael U Dotoozof, Director, MTF Laboftioty for Compuicr Science, lestimoiiy m bemogs bcfote the Joint Ecooomic Commioee, June 

12, 1992. 

5 Svm A. BIy et al., **M©dia Spacea: Brii^ Pteopk Tbgcihcr ia a Video, Awiio, and Computing Enviroooieiit," CommmcMions ofth€ 
ACM, vol. 36, No. I, Jtfmacy 1993. 

* Matthew Anott and Sart Latta, •'Pcfipectivcs on Visualizatioo,** IEEE Spectrum, vol. 29. No. 9. pp. 61-65. 
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Ay part of the CASA testbed research described in chapter 4, a gigabit network will be used to combine data from 
a variety of sources, such as satellites and digital elevation models^ to create three-dimensional views. 



be possible to better emulate the classroom 
environment by allowing more two-way coiranu- 
nication than is currently possible. Students 
might also be able to select a particular view of an 
experiment being demonstrated by a teacher. In 
health care, transfer of bigh*resolution images, 
such as x-ray and MRI data, combined with 
videoconferencing and other collaborative appli- 
cations, could allow doctors to consult with 
specialists in other areas of the country.^ 

I Distributed Computing 

Other researchers have begun to consider the 
relationship between computers and communica- 



tions in a more general way. **Distributed com- 
puting'' uses the network to combine the process- 
ing power and memory of multiple con^uters. It 
is then possible, for example, to combine several 
low-cost workstations to achieve performance 
comparable to that of a supercomputer — a very 
expensive machine to purchase and operate. 
Computations can also draw on data stored in 
many different locations. Distributed computing 
becomes feasible as the network connecting the 
computers becomes less of a bottleneck, allowing 
them to work more closely together. 

It may also be useful to do distributed super- 
computing — ^using the network to provide proc- 



3 M. Nicl RjuMom and Dan R. Spevs, **AppUaitioDi of Public Gigabit Networks/* IEEE Network, vol. 6, No. 2, March 1992, p. 31. 
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Box 3*A— Interactive Viaualization Using Gigabit Networics 

Sctonttsts at the UnhMTSity of Wsoonsin's Speoe Sden^ 
pactaga that alkywt *Marae^ive" vtfualte^ 
dii|)iay 8h(m both a computed foracast of cold fr^ 
that the adenUst can use to coaM the imagaf di^^ 

Cnnputars gMiacata nawHnds 
of images, that change in mponsa 
to their users' needs. If the sdenlist 
seiects the command ''animate,** In 
the upper left hand corner of the 
control panel, the workstation wW 
display a succession of images that 
show the evolution of the slorr 
time. Other commands allow the 
user to rotate and ''zoonf the 
images, to look at them from any 
angle. 

The time required for a work- 
station to compute a new image, in 
response to a user command, can 
be significant A supercomputer 
wouki be able to reduce the re- 
sponse time and aUow interacthw 
exploration of the data computed by the model. However, like many research institutions, the IMversity of 
Wisconsin does not have a supercomputer. 

The internet couM be used to send data to one of the NSPs supercomputer centers. However, the data rate 
of today's internet is too tow-the advantages of speeding up the computatkm by using a supercomputer are 
outweighed bythe time needed to transferthe model data toandfromthesupero^ 
the communkatkm time wouM no tonger be a bottleneck. 

As part of the BLANCA testbed's applk»tk>ns research (see ch. 4, p. 56), University of Wisconsin scientists 
wil use a gigabit network to support interact^e visualizatkm of large data sets. TTie user's commands wouM be 
sent from the wod(Statk)n through the networic to a supercomputer at the Natk)nai Center for SupercompuUng 
Applk»tk>ns,inChampaigailnois,whtehwoukidomostofthe 

back to the wortcstatkm for display. This testbed research may serve to demonstrate a way for the majority of 
research institutkxis that do not have supercomputers to do interactive visualizatton. 

SOURCES: WWl«n Hibterd, Unlwiity of Wtooon»ln-^«ot Sdww and EnginMrinQ Ctnttf. Mtr. 11, ISW; Will«n Htobwd, D«vid 
SMtak. and Qragofy TripoM, -imwtiv* Atmotphirtc D«u Aoom Vl« High^pMd mm&Mr Compulfr /MMNto md ISDN Sytmrn, 
VOL 22, pp. 103-109. 




essing power that exceeds that of a single 
supercomputer^ (sec lx>x 3-B). Superconq)uter 
applications are often simulations of real-world 
phenomena; for example, airplane designers do 



not need to build a model of an airplane and test 
it in a wind tunnel, but can simulate the flow of air 
around the airplane on a supercomputer. Unfortu- 
nately, for many ir teresting problems the process- 



< Cbvloi E. Catktt, • 'In Search of Gigabit AppUcation*,* * IEEE CoTnmunications, vol. 30, No. 4, April 1992, pp. 43-45. 
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CASA GIGABIT NETWORK 



ERIC 



CRAY YMP 116 



INTEL DELTA 



CRAY YMP 264 




CRAY YMP 864 



r.ONE'T DC *8' 



THINKING MACHINES CM-5 

□ 



The CASA testbed will use a gigabit network to link supercomputers at the Calif ornia Institute of Technology 
(CIT), Jet Propulsion Laboratory (JPLh Los Alamos National Laboratory (LANL), and the San Diego 
Supercomputer Center (SDSC). 



ing time required with even the fastest supercom- 
puter can be significant^ Researchers hope to 
reduce this time by using multiple con^uters in 
parallel and linking them throu^ a network. The 
network cotild also connect the superconqmters to 
scientific instrum^ents or massive remote data- 
bases that would provide data to be used in the 
calculations.^ 

I Applications and Networic Requirements 

Two requirements will be placed on future 
networks. First, they will need to have much 
higher bandwidth than today's networks, in order 



to keep pace with advances in computer technol- 
ogy and support bandwidth-intensive video- 
based and distributed computing s^lications. 
Distributed supercon^uting applications would 
require even greater increases in network band- 
width. Second, the networks will have to be more 
flexible than today's networks — they will be 
supporting a more diverse range of services, with 
a wider range of bandwidth requirements. 

HIGHER BANDWIDTH 

The bandwidth requirement for each type of 
application depends on a number of factors. 



7 Office of Science IbctMiology PoUcy, ''Gfand ChftUeoges 1993: High PerfonniDce CocB|mtin( ttd Commonicatioiis,** p. 15. 
* Catlett, op. cit, foomoie 6, pp. 46-49. 
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Box 3-B-Distributed Supercomputing 

Superoomputar-baaed shnulatkm art btooming MMntW tools for tdanca and anginMring. Ollan, 
sdMiUstsareabiato study pfoUeirath^ 
Rv examplt, a raimbar of researchers ara dovek^ 

of the Earth'e climate over the coining decades. Computational science Is becoming mors widely used as the 
increaskig power of new superoomputsrs brings more proUenw witM^ 

(>» of the goals of the HP(X) program is the development of computer tschnol^ 
10 tadde probleme that an beyond the capabilities of toda/s maohinee. 
compute-some current models of the orone depletion prooese take 10^ 
the complex chernicalreacttone that tahi place in every day of "^eal"^^ 
a useM level of detail--computer power mi(^ limit a dimate model to tF« 

only a limited number of points on the globe. 

Greater processing power isalsorequired for ''interactivity,'* ocmpM 
to t*e some actton to contrd an instnjmsnt, change the parameters of 
inadataba8e(seebox3-A).ThisreqiAesthattheoomputatk)nofthemo^ 

done in a fractten of a second. Today, images can take a consWerable amount of time to compute, and are 

generallyprocessed''offline'*afterthecomputatk)nhasbsenoompleledBec^ 

newly computed or coHected data, much of the data Gften goes unused. 

The testbed prognm is investigating the use of gigabit networks to heip address difficuit computattonal 
science problems. High-speed networks may enable increased processing power, by linking several computers 
through the network. For example, a nwdelcouW be computed on a supercomputer 
graphks processor for the visualteation processing, or a model couW be split into two parts, with two 
stif)ercomputers workkig in parallel to solve the problem. r4^^ 
in a computatk)n--4arge databases and sdentif k: instiuments, for example. 

In the testbeds described in chapter 4, distributed supercomputing is used to increase processing power to 
study tong-term weather models (part of the CASA testbed research), molecular dynamtes (NECTAR), and 
chemkal modeling (CASA). The use of networiad computers to speed up the visualization process in an 
interacthre teshfon is being exptored as part of applicattons for medkal treatment planning (VISTAnet) and radk) 
astronomy (BLANCA). Navigatfon of multiple large databases and associated visuallzatk)n are used for terrain 
visualizatton (CASA), atmospherfo sciences (BLANCA), and terrain navigafion (MAGIC). 

The testbeds are also woriung on the systems software and 'tools" that wiH support these applioitkms. 
Today, Implementing distributed applkations requires detailed knowledge of the behavtor of the network and the 
characteri8lk»ofditferentcompulers. Distributed supercomputing wiU^ 

be freed of the need to learn these details, and can concentrate on the edence aspects of their simulattons. The 
testbeds are devefoping ironware modules that implement commonly used functfons, and programs that automate 
parts of the applkatkms devefopment process. In the fong nin, the objective Is to create software support and 
distrtxited operating systems for a "metaoomputer," whfch wouW hkis the complexity of networi^ compilers and 
appear to the programmer as a single computer. 

SOURCES: <UryStix,-Gl9iajltCo«i»ctJoo,'' Sc<trtttfcAn*fe^,Octob«'1W0,pM18;Matth^ 

VtouiJIittioor IEEE Sptctufn, vot 29. No. 9. S«pl»mb«f 19S2, pp. 61-65; Urry Smarr and ChariM E. Caflttt, "Mataoomputingr 
CommuntoaltoM ol §m ACM. vol. 35, No. 6. Jona 1902. pp. 46^; Offtea of Sdanoa and Tachnotogy Policy. "Grand Chalanoaa 1993: 
High Parformanoa CompuUng and Communicationt." p. 54. 
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Because of advances in **conq>iession** technol- 
ogy, it now {q)pears that relatively modest in- 
creases in bandwidth can accommodate many 
simple video and multimedia applications. Thaw 
are many ways to convert a video signal to a 
digital stream of bits; new compression algo- 
rithms arc able to squeeze the information content 
into fewer bits without significantly affecting 
picture quality.^ These improvements have re- 
sulted from a better understanding of the mathe- 
matics of signal processing and also from re- 
search on how people perceive images.^^ In 
addition, increased processing power due to 
advances in microelectronics has allowed sending 
and receiving computers to do more complex 
signal processing. 

Advances in compression technology have 
been dramatic. While it was once believed that a 
155 Mb/s fiber optic link could cany only a single 
high-definition television (HDTV) si^, it is 
now believed that such a link can carry five or six 
HDTV signals.^^ In addition, it now spears that 
many simple video and multimedia applications 
will not require broadband fiber access to the 
network. New con:q)ression techniques are able to 
con^jress VCR-quality video to a few megabits 
per second, bandwidths that can be supported by 
new schemes for converting the telephone com- 
panies' existing copper local loops to digital 
service.^^ There are a number of emerging video 
and image conq)ression standards — the most 
prominent of these will be the HDTV standard to 
be chosen by the Federal Communications Com- 
mission in 1993.^^ 

However, there are still many possible applica- 
tions that would more fully use the capacity of 



fiber,^^ These are the kinds of applications that are 
being investigated by the testbeds described in 
chapter 4. One possibility is distributed super- 
computing — the use of higji-bandwidth links to 
combine the processing power of multiple supcr- 
computer/s. There are also applications that re- 
quire images or video of a quality that can be only 
supported by fiber, despite advances in con^qpres- 
sion technology. In some cases, such as some 
medical applications, compression cannot be 
used because it destroys vital data. Other zpphcar 
tions may demand very high bandwidths because 
many nv^iium bandwidth streams of data are 
delivered to the user at once, allowing the user to 
select, combine, or process the streams at the 
workstation.^^ "Tfelepresence'* or * Virtual real- 
ity** supplications require the delivery of large 
amounts of data in order to create the illusion of 
a user being in a distant location. 

FLEXIBILITY 

The second requirement the envisioned appli- 
cations place on advanced networks is flexibility. 
First, new network technologies should be suffi- 
ciently flexible to cany all kinds of traffic. The 
integrated services concept envisions a network 
in which the same links and switches are used, to 
the extent possible, for aU types of traffic. 
Integrated services netwoiks may be more effi- 
cient than separate netwoiks, and would also 
match advances in computer technology that 
allow computers to run multimedia applications. 
Today, different network technologies are used 
for voice, video, and ordinary data traffic. As new 
services were required, new types of networks 
were constructed. The telephone network was 



> MiikRobicIuux, **Necd More TV? TQ May Offer SOOOuimcli/' Wall Street Journal, Dec. 3, 1992, p. Bl. 
10 P. H. Ang ct ''Video Compression Makes Big Gtlni," IEEE Spectrum, October 1991, pp. 16-19. 

n Sec, foe t uWc of Undwidth requiianents for compressed signals, J. Biyan Lylcs and Daniel C. Swinchait, ''Itic Emefging CSigabit 
Envinxmicm and the Role of Local ATM." IEEE Comimnications, vol. 30, No. 4, p. 54. 

»2 Charles F. Nfatod, "BcU Atlantic Stretches Copper for Video Trial,'* Telephony, Oct 26, 1992, p. 10. 
«5 Mark Lcwyn, ''Sweating OvA the HDTV Contest," Business Week, No. 3306. Feb. 22, 1993, pp. 92-94. 

14 lunsom and Spesrs, op. ctt, footnote 5, pp. 30-40. 

15 Lyles and Swinehart, op. ctt, footnote 11, p. 55. 
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augmented first by packet switched networks for 
data and then by a variety of specialized networki^ 
for video communication^^ and distribution^ such 
as cable television networks. Separate netwodcs 
were required in part because no switching 
technologies worked equally well with all serv- 
ices. 

Broadband networks should also be able to 
accommodate a range of ^plications band* 
widths, from the very small amount of bandwidth 
required for ordinary electronic mail to the gigabit 
rates needed for distributed supeiconq)uting. 
Some kinds of switching technologies are more 
flexible than others in accommodating different 
band widths in the same network. Circuit switches, 
the type used in the current telephone networic, 
limit £^plications to a small number of predeter- 
mined bandwidths, while packet switches are 
more flexible. 

Flexibility is also important from a network 
planning standpoint. While there are some gen- 
eral ideas about the ways in which broadband 
networks will be used, there is no real operational 
experience. Ideally, the network technology that 
is deployed would be able to accommodate a 
range of different scenarios, and its effectiveness 
would not depend on network planners knowing 
the exact mix of future applications in advance. In 
addition, future networks will have to suj^rt a 
more diverse range of users, each with different 
bandwidth and service requirements. Network 
operators would like to deploy network technol- 
ogy that could provide services to a diverse range 
of users with a minimum amount of customiza- 
tion. 

FAST PACKET NETWORKS 

A number of new concepts for network design 
may meet the requirements for flexible broadband 
integrated services networks.^'' There is general 
agreement that these networks will rely on fiber 



optic transmission, which has sufficient band- 
width to carry video and other types of bandwidth- 
intensive services. There is also general agree- 
ment that future networks will use a concept 
called ''fast packet switching,'' which provides 
the necessary processing power to keep up with 
increases in link bandwidth and the necessary 
flexibility to support different kinds of services 
md a range of bandwidth requirements. 

Fast packet networks overcome the main weak- 
ness of traditional packet networks by using 
special control mechanisms to provide the con- 
sistent networic performance required for video 
and other real-time services. In traditional packet 
networks such as the current Internet, the network 
could become heavily loaded in a way that 
degraded these services. Researchers are looking 
at a number of different schemes to either prevent 
networks from becoming too heavily loaded, or to 
minimize the effects of a heavily loaded network 
on traffic such as video that is sensitive to 
network performance. Fast packet switches can 
then act as the foundation for integrated services 
networks. 

Both the computer and telecommunications 
industries are investigating fast-packet approaches. 
In response to the emerging consensus for these 
technologies, considerable work has been done 
on the development of the necessary network 
components such as switches. However, until 
recently most experience with these networks had 
been confined to relatively small-scale experi- 
mentation with local area networks, or simulation 
and mathematical modeling. One of the main 
purposes of the testbeds described in chapter 4 is 
to demonstrate these networks in a realistic 
environment. In addition to the testbeds, a number 
of other experimental fast packet networks are 
now being planned or are operational. 

Two different kinds of fast packet switching 
are being studied by the testbeds. The most 



J< Vot eximplc, the CONCERT nciworfc in North CaroltiiA uses high-bandwidth microwive links to tnppoit videoconferencing and 
**telecbuies.** 

17 Nim K. Cheung, **The Infristructure for Gigibit Computer Nctworki,"/£££Cow«i^^ April 1992, p. 60. 
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prominent of the fast packet switching concepts 
was first chanc^ioned by the telephone conq)anies 
and is called Asynchronous Transfer Mode, or 
ATM.*^ ATM has been chosen by the telecommu- 
nications industry's international standards group, 
the CCirX as the foundation for the Broadband 
Integrated Services Digital Network (B-ISDN), a 
blueprint for the future development of die 
telephone network.*' B-ISDN envisions the pro- 
vision of 155 Mb/s or 622 Mb/s fiber optic access 
links to each customer, which would then be used 
to carry voice, video, and data traffic to support a 
range of J^plications.^ 

One of the most significant aspects of ATM is 
that it has subsequently been adopted by many 
companies in the computer industry, and by 
manufacturers of equipment for local area net- 
woiks and private networks. This convergence 
with telecommunications industry plans^* may 
simplify the task of connecting different kinds of 
networks — ^in the past, local and wide area 
networks have used different technologies. How- 
ever, technologies other than ATM have also been 
proposed for local area networks. Most of the 
testbeds described in the next chapter are using 
supercomputer industry networking standards 
that require the construction of modules that 
convert between the supercomputer network for- 
mat and ATM. 

While most packet networks use packets that 
can be very long and vary in size depending on the 
data being carried, ATM networks use short 
packets called ''cells'' that are always the same 
length (figure 3-1). If an ATM network is being 
used to carry Internet traffic, the Internet packets 
would be broken into a series of cells (figure 



Figure 3-1— ATM Call 



Data 


Header 


(48 bytes) 


(5 bytes) 



International standards specify that ATM ceils are 53 **bytes" 
long, 48 bytes to carry the applications data and 5 bytes for 
the header, which ;s used to carry such information as the 
destination's address. By contrast, the packets used in 
traditional packet networks can be several thousand bytes 
long. A "byte" is the con^puter science term for eight t>its. 

SOURCE: OffiM of TKhnok)gy AMM«n«nt 1993. 

3-2(a)). After traveling through the network, the 
cells would be reassembled into the Intemet 
packet and delivered to the destination con^uter. 
The same network could also cany video or 
sound: as the video or sound was digitized, the 
conq)uter would load the bits into a cell (figure 
3»2(b)-(c)). As soon as the cell was fiUed, it would 
be sent into the network and die user would begin 
filling the next cell. The cells carrying the video 
and Intemet packet data would travel through the 
network together, sharing the same links (figure 
3-3) and being processed by the same switches. 

The second approach to fast packet switching 
being studied by the testbeds is called Packet 
Transfer Mode or PTM. The version being 
studied in the testbeds has not been adopted by 
standards committees* PTM does not use short 
cells, but more traditional packets that can be 
longer if necessary. This may simplify the task of 
carrying long Intemet packets, because the com- 
putor does not have to break up the packet into 
many cells. ATM may also encounter problems at 
very high bandwidths — because the cells are so 



Robm W. Lncky, Executive Director, Commufiicatioai Scieaco Retearch Diviik>ii, ATAT Bell Laboratories, tcftimooy at bearings 
before the ioim Economic Coimiiittee, June 12, 1992. 

1' A. Day, ' 'bUeniatioiial Staodaidizatioii of B-ISDN,** IEEE ITS, vol. 2, No. 3« August 1991. 

^ Peter Bocke awl HeunchAfiiibnuter, **BR>a(lbaad Services: An Overview/* TtUcommumcattptu, vol. 25, No. 12, December 1991, pp. 
24-32. 

21 JohaJ. KeUer, **ATftTSea Allinceio Make Gesr to PtovideMdcimedia Services,* * V^a2f5re 1993, p. B6; Jobo 

McQuilbn, *'Wbo*s Wbo ia ATM,** Businexs Commumcations Rtview, Aiigiist 1992, p. 10. 
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Figure 3-2— ATM 
(a) Data communications using ATM 
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Packets are broken into several ATM cells. After travelling through the network, the cells are reassembled Into packets. 



(b) Video comrrunications using ATM 
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ATM cells 

The digital video bits are put in cells and sent through the network. At the destination, the bits are removed from the cells. 



(c) Voice communications using ATM 



Digital voice 
-> j\ru rLTLTLrLrL 



n tzztitiiii 

ATM cells 




Voice is handled in the same way as video. 



SOURCE: Office of T«c*inok)gy As$«Mm«nt, 1993. 

short, there is little time to process each cell 
before the next one arrives. However, ATM 
proponents believe that the use of cells makes it 
easier to develop the control mechanisms that 
support real-time traffic such as video, and to be 
better suited to voice traffic. One purpose of the 
tcstbed research is to compare the two approaches 
to fast packet switching with realistic traffic. 



NETWORK COMPONENT DEVELOPMENT- 
CURRENT STATUS 

The telecommunications and computer indus- 
tries have been working intensively to develop 
components for fast packet networks. The compo- 
nents arc in varying stages of development. Fiber 
optic transmission links arc the most advanced in 
their development — ^very high bandwidth optical 
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Rgure 3-3— 4ntegrated Services Using Fast Packet Switching 



(a) Today, separate netvvorks for each service 




(b) Fast packet switched network supports all services 




SOURCE: Offico of Tschnology As$M3m«nt 1993. 



transmission systems are now commercially avail- 
able. Fast packet switches are the subject of 
considerable industry research and development; 
most of the major telecommunications industry 
suppliers have had intensive ATM switch devel- 
opment efforts since 1987 or 1988, when it 
became clear that standards groups were going to 
adopt ATM. Some fast packet switches are 
becoming available commercially, but switches 
are less advanced in their development than the 
fiber optic links. Important work also remains to 
be done on the design of the software and 
hardware that handle the connection between the 
computer and the network. 

I Optical Fiber 

Optical fiber has clearly emerged as an ena- 
bling technology for broadband networks. With 
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increased bandwidth the links will be able to 
move data more quickly and support the transport 
of bandwidth-intensive traffic such as video. The 
development of the transmission equipment that 
handles gigabit rates is no longer a research issue. 
Although configured to support voice telephone 
calls, many fiber optic links in today's telephone 
network operate at more than one gigabit per 
second. Furthcimore, the fiber cable is already 
widely deployed in much of the telephone net- 
work, especially in the interoffice portions of the 
network that will provide most of the transmis- 
sion facilities for the agency backbones and 
regional networks. 

For the telephone company fiber links to 
support the gigabit NREN and other broadband 
services, new transmission equipment will have 
to be deployed. This equipment is expected to 
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confonn to a new standard called Synchronous 
Optical Network (SONET), and is now becoming 
commercially available. While fiber has been 
used in the telephone network for a number of 
years, the link opacity was mainly configured to 
carry thousands of low bandwidth telephone 
calls. SONET transmission links, on the other 
hand, can be configured to support the high- 
bandwidth channels required for advanced net- 
woiks. For example, the transmission facilities to 
be used in the testbeds employ a 2A Gb/s SONET 
link, which can be divided into four 600 Mb/s 
channels. 

I Switches 

The development of fast packet switches is less 
advanced than the development of transmission 
links. However, there has been considerable 
theoretical work done on switch design, proto- 
types have been developed, and some early 
commercial products are becoming available. By 
the end of 1993 or early 1994, several suppliers 
should have ATM products on the market. The 
early products are designed primarily for private 
networks or carrier networks operating at 45 Mb/s 
or 155 Mb/s, not gigabit rates. 155 Mb/s is the 
bandwidth specified by the telecommunications 
industry's standards group, the CCli'i, for the 
Broadband Integrated Services Digital Netwoik 
(B-ISDN) service. 

There are many different ideas for how to build 
fast packet switches — die "best** design depends 
on assumptions about the number of users, the 
bandwidth of the netwoik, and the mix of traffic. 
However, all of the proposed switch designs rely 
on hardware, in order to speed the processing, and 
are usually based on ' 'parallel' ' designs that 
aUow many packets or cells to be processed at 
once. 



If ATM switches do become central to tele- 
phone conq)any networks, then there will be 
demand for large switches to replace the current 
''central offices** that handle tens of thousands of 
lines. Most of die ATM switches now becoming 
available only handle a small number of lines — 
16 or 64 lines are common configurations* 
Initially, ATM switches will probably be intro- 
duced to support new services, rather than as a 
replacement for existing central office switches.^ 
Building an ATM switch that can serve thousands 
of lines is a difficult task, requiring further 
research on switch design and device technology 
and packaging. The move to ATM switching has 
the potential to change the market positions of 
telecommunications equipment manufacturers, 
much as the transition from analog to digital 
created market opportunities in the late 1970s.^ 

Switches control the fiow of packets using 
considerable software "intelligence.** For exam- 
ple, if the network is heavily loaded, a switch may 
decide to handle video or other performance- 
sensitive traffic first. Switches may also help 
prevent the network fit>m becoming too busy — 
they may prevent a user from sending traffic, or 
verify that users are not using more than their 
share of the network capacity. These aspects of 
the control of the network are still important 
research issues, however; there are many different 
proposals for managing fast packet networks. As 
a result, some of the prototype switches used in 
the testbeds described in chapter 4 are flexible 
enough to allow researchers to reprogram the 
network control mechanisms. 

I Computers 

The use of high-bandwidth links and switches 
will expose new bottienecks inside many comput- 
ers.^ New con^uter designs may have to be 



^^VachMiaKupiiuki,**J>JD£ti\6chUw€i^ Mar. 1, 1993, p. 14. 
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56 



Chapter 3— Broadband Network Technology 1 47 



developed to improve the rate at which data can 
be transferred from the network, through the 
conq)uter's intonal circuitry, and into memory, 
where it can be used by the s^lications software. 
Both the internal circuitry and the memory of 
today's computers are limited in the rate at which 
they can transfer data. In the past, the design and 
operation of computers has focused on the task of 
maximizing the processing power once the data is 
in memory, not the larger problem of maximizing 
the performance of networiced supplications. 

Computers may also require additional proces- 
sors or hardware to process protocols* With low 
speed networks, the computer's naain processor 
was powerful enough to handle the communica- 
tions functions and still have enough time left to 
run applications. This ntiay continue to be the case 
as the processing power of computers continues 
to increase. However, in some cases it may be 
necessary to relieve the processor of some of the 
burden of handling the communications func- 
tions. This is likely to be the case with ATM- 
based networks — because the cells are so short, 
there are many cells to be processed in a given 
amount of time. Special •*network interfaces" 
that speed the protocol processing arc being 
developed for a ntmiber of different computers as 
part of the testbed project discussed in the next 
chs^ter. 

APPLICATION OF BROADBAND 
TECHNOLOGIES 

The broadband technologies discussed in this 
chapter will be used in both the Internet and in 
other netwo^s, such as private networks or the 
public switched network. The use of broadband 
technologies in the Internet is linked to their 
deployment in the public switched network in two 
respects. First, the Intemet will probably continue 
to rely on the public network's transmission 



infrastructure. As a result, it is dependent on the 
rate of dq>loyment and the cost of SONET links. 
Second, the carriers may use their new ATM- 
based infrastructure as a way to play a more active 
role in the computer communications business 
and offer Intemet services. 

I Application to the Internet 

The links in the high-speed networks in the 
core of the Intemet are expected to use the 
SONET-based transmission infrastmcture that 
the telephone con^anies are planning to deploy. 
SONET is actually a family of transmission 
rates— there is 155 Mb/s, 622 Mb/s, and 2.4 Gb/s 
SONET equipment becoming available now. 
Users that need access to the Intemet at broad- 
band rates will also use SONET for their access 
links. Large universities and commercial users of 
the Intemet would be able to make special 
arrangements with their local exchange carrier for 
the provision of fiber access. The rate at which the 
carriers will more broadly deploy optical fiber in 
the local loop depends on the resolution of 
complex economic and policy issues. 

However, many users of the Intemet will not 
require fiber optic access links in the near term. 
The carriers have proposed several new technolo- 
gies that would convert existing copper local 
loops to digital sCTVice. These technologies do not 
support true broadband capabilities, but still 
represent a significant improvement over the 
existing analog local loop. They include the 
Integrated Services Digital Network (ISDN) (see 
box 3-C for a description of ISDN), High-bit-rate 
Digital Subscriber Line (HDSL)^, and Asym- 
metric Digital Subscriber Line (ADSL) standards. 
ISDN provides access at 144 kb/s; HDSL pro- 
vides access at 768 kb/s. These technologies are 
available on a limited basis from the carriers and 
are the subject of a number of trials and demon- 
strations.^^ The pace of their deployment dq)ends 
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Box 3^SDN 

ISDN (M«gratod ServiCM Digital Network) is a teltoommunications inckistry standard for upgrading locai 
loops to digital sdrvk». This last mile'' of the rio^^ 
is less sophisticated than other parts of the netwoiK The core of the tel^^ 
fber optic Hnks. The local loop, by contrast, uses iow^ca^ 

for ordinary telephone service, but more sophisticated services wii rec^ upgraded local loops. 

When work tiegan on the ISDN standards In the mkl-1970s, it was t)elieved that ISDN wouM soon be 
depk)yed to aX of the telephone network's customers. Today, ISDN is used only on a very limited basis, due to 
delays In compieting thestandardsandseveralreguiatory and economtequMtions. Because of the dsl^ 
deploying ISDN, large business customers found more capable technotogies. More importantly, a new viston of 
the future of the k)cal k)op emsrged-the wiring of homes with fiber optks iinke-«nd ISDN was no viewed 
as a technofogy with an important role to play. 

There is now renewed interest in ISDN, however, as an "intermediate" step between the current anak)g \ocal 
kMp and the use of fiber optk^s. Because of the cost of deptoying fiber, it may be man^ 
numbers of homes are connected ISDN is cheaper than fiber, can be depk)yed sooner, and, while its capacity 
is only a fractkxi of fiber's, represents a signif kant improvement over the current anak)g k)cal foop. WhUe ISDN 
wil not become the unh/ersal network standard once envisk)ned. It may play a role in provkJIng better network 
access to certain groupe of users. 

For example, one possible applk»tk)nmightbeteleco(nmutlng,whkA 
computer at home. Toconned to the offtoe computers, woricers today woukineedadevk»c^ 
Ms them send digital computer data over the ariatog k)cal k)Op. Common modem standards transmit data at 2^ 
or 9,600 bits per second; ISDN, by contrast, provMes two 64,000 bits per second (64 kb/s) channels. This woukJ 
alk>w vkJeoconferendng of reasonable quality, faster transfer of graphk^ informatkMi, and better quality fax 
transmisskHt It wouM also permit much-improved access to the Internet for home users. Today, good-quality 
access to the Internet is usually only avsiiabietoiargecustomerswhoa^^ 
lines to be provkied by their k)cal telephone company. 

ISDN alkyws the existing copper kxxU loops to be used for digital $ervk». However, it requires users to buy 
now equipment for their end of the line, whk:h converts their data to the ISDN format tt also requires that the 
telephone company's equipment, such as the "central office" switches, be upgraded. Currently, the user 
equipment Isexpensive and only one-thkd of the telephone lines are connected to switches thatare"ISDN ready." 
In additkm, ISDN communk:atkMis are hampered by the fact that different equipment ntanufacturers have 
implemented their own versk)ns of ISDN, despite the fact that it was devek)ped to be a standard. In most of the 
United States, ISDN is not available as a regular servk». 

However, some progress is being made kyward overcoming ISDN's problems. The Industry has a number 
of initiatives that are intended to encourage the devek)pment of ISDN equipment that conforms to a common 
spedfkatkxi. The Regkjnal Bel Operating Companies, whteh provkle kxal telephone servk» in most of the United 
States, have announced that they are planning to make 56 percent of their lines ISDN-ready by the end of 1 994. 
in additkxi, the cost of users' ISDN equipment may decline as it becomes more wkiely used. 

Broadband ISDN, whk^h is discussed on p. 46, uses very different technotogy from "ordinary" or 
"narrowband" ISDN. Narrowband ISDN Is best viewed as adigital upgrade 

kwp. Broadband ISDN, by contrast, requires fiber optfcs and Asynchronous Transfer Mode (ATM), a newapproach 
to network design discussed in detail In this background paper. ISDN and Broadband ISDN have little in common 
other than their names. 

SOURCES: Jmnm H. BudvMy. "Ift TVn# to 0«t Off th* WTS;- Tthoomm u nkMliOM, August 1SS2. p. 4; Cindy ShnycW. 'Dtla rtghwty 
Ptan Cottft May 0^d^km:' Vm Wmhhg^ Po^ JvlTO, 1SS3. p. Gl; Bob WiMftM, ''Study naiM Coootmt About National ISDN," 

IWiddt Juna », 1»ft2. p. 27; Miki»« Ktpor. Proo^ 
Suboommlttoa on Tolocommunioationt and FIntnoo. Jan. 19. 1SS3: ^ 
Nm Yofk Vmm, Fab. 23. 1SS3. p. 02. 



ERLC 



58 



Chapter S-Broadband Network Technology 1 49 



on resolving standards issues and on business 
decisions made by the carriers.^'' 

Internet traffic may be handled by some of the 
new fast packet switching systems. As was noted 
above (p. 43), fast packet networics can carry 
Litemet traffic if the Internet packets are first 
converted to the appropriate fast packet format — 
for exanq>le, if the Internet packets are broken up 
into a series of ATM cells. It is likely that other 
types of switching technologies will also be used 
The success of the Internet is due in substantial 
part to the commonality of protocols that support 
the technological diversity of the interconnected 
networks. Some networks will continue to use 
''routers/' similar to those used in today's 
backbone networks, while others may employ the 
new fast packet switching technologies or some 
of the new data conununications services that the 
carriers may o^er, such as Ftzxoc Relay or SMDS. 

I Public Network 

In many ways, the most iignificant aspect of 
ATM is that it was first championed by the 
telephone companies and is now a key component 
of telephone company planning. ATM represents 
a dramatic change in the design of telecommuni- 
cations industry networks. Traditionally, the in- 
dustry has not used packet switches. It used the 
circuit switches that were ideally suited to carry- 



ing voice telephone traffic. The industry stand- 
ards group, the CCITT, chose ATM because it 
believed that sinq>ly upgrading the existing cir- 
cuit switched netwodc to higher bandwidths 
would not provide the necessary flexibility to 
siq>port future services. ATM is a central compo- 
nent of carrier strategy; ihey hope to use ATM as 
the basis for a range of future services, including 
video, Internet services, and other data communi- 
cations services such as Frame Relay or SMDS.^ 
ATM's flexibility offers the carriers an oppor- 
tunity to enter a variety of markets and quickly 
offer new services with a common infirastructure. 
However, some believe that ATM's flexibility 
also means that it is a compromise technology, 
and that more specialized network technology 
will cc inue to play arole.^^ Moreover, there arc 
still important economic considerations for the 
telephone companies as they determine the best 
way to evolve fi:om the current networic to an 
ATM-based infrastracture.^^ Both service provid- 
ers and manufacturers are facing difficult deci- 
sions about the timing of their investments and 
the £^)propriate migration scenarios*^^ Dep oy- 
ment decisions depend on estimates of future 
revenues, equipment costs, the viability of com- 
peting technologies, and the carriers' investment 
in their existing networks. 



27 Edmund L. Andrews, ***Baby Bells* Rift Threjueoi An Advanced Phone Service/* The New York Times, Dec. 1, 1992, p. Dl. 
2* Ben Usowski and Louise Reingold, "Spdnt*t Evolution to Broadband ISDN/* IEEE CommunicatiGns, August 1992, vol. 30, No. 8. pp. 
28-30; John Williamson and Steven Titch, '^Gazing Tbwird the Broadband Horizon,** TeUphony, Oct S, 1992, p. 38. 

^ Chin-Tui Lea, **What Should Be d» Goal for ATM?** /££E Commuiicaiions, September 1992, vol. 6, No. 5, pp. 60-66. 

» Stephen M. Walters, "A New Direction for Broadband ISDN,'* IEEE CommuniciUions, vol. 29, No. 9, September 1991, pp. 39-42. 

31 Carol Wilson, **It*s Not That You Do It, But How You Do It lliat Counts,** Telephony, June 15, 1992, p. 9. 
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AS was discussed in chapter 3, the liniitations of current 
networks and advances in con^uter technology led to 
new ideas for applications and broadband network 
design. This in turn led to hardware and software 
development for switches, computers, and other network compo- 
nents required for advanced networks. This ch^ter describes 
some of the research programs that are focusing on the next 
step — the development of test networks.^ This task presents a 
difficult challenge, but it is hoped that the test networks will 
answer important research questions, provide experience with 
the construction of high-speed networks, and demonstrate their 
utility. 

Several "testbeds" are being funded as part of the National 
Research and Education Network (NREN) initiative by the 
Advanced Research Projects Agency (ARPA) and the National 
Science Foundation (NSF). Tlie testbed concept was first 
proposed to NSF in 1987 by the nonprofit Corporation for 
National Research Initiatives (CNRI). CNRI was then awarded 
a planning grant, and solicited proposals or ' 'white ps^>ers'* from 
prospective testbed participants. A subsequent proposal was then 
reviewed by NSF with a focus on funding levels, research 
objectives, and the composition of the testbeds. The project, 
cofunded by ARPA and NSF under a cooperative agreement with 
CNRI, began in 1990 and originally covered a 3-year research 
program. The program has now been extended by an additional 
fifteen months, through the end of 1994. CNRI is coordinat- 



1 CofpocacioQ for Ntckmal Research Imtiitivet, **A Brief Description of the CNRI 
Gigabit Ibttbed laitiative/' Junaiy 1992; Oary Stix, **Gigabit Connecrioii,** Scientific 
American, OctolMr 1990. pp. 118-1 19; John Maricoff. "Computer Pr^jct Wwild Speed 
Data.** The New York Times, Jnne S. 1990. p. Al; "Oigabit Network Tfettbedt," IEEE 
Computer, vol. 23, No. 9, September 199a pp. 77-40. 
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ing five testbcds; a sixUi tesd>ed, funded by 
ARPA alone, was announced in June of 1992. 

The testbcds are investigating gigabit net- 
works, very high-speed broadband networks that 
represent the limit of what can be achieved today. 
Moft current work on broadband networks is 
looking at lower bandwidths, such as the 155 
Mb/s rate that will be used for the telephone 
con:q)anies' B-ISDN service. Because of the focus 
on gigabit rates, some suspects of the testbeds' 
research agenda are unique. In other respects, 
however, the testbeds are one of a niunber of 
research programs whose work will impact the 
NREN — ^fast packet switching technologies, for 
example, are being studied as part of many 
industry research projects. 

RESEARCH OBJECTIVES 

In general, the objective of the testbeds is to 
speed the deployment of advanced netwodc tech- 
nology, in the NREN and elsewhere. The net- 
works are designed to provide a realistic test 
environment for the technologies outlined in the 
previous chapter. The switches and transmission 
equipment conform to emerging industry stand- 
ards wherever possible. More speculative con- 
cepts such as optical switching are not being 
investigated by the testbeds — the focus is on the 
network technologies that are central to near-term 
industry planning. One purpose of the testbeds is 
to look at unresolved research questions. How- 
ever, the most valuable aspect of the testbeds will 
be to demonstrate the feasibility of these networks 
and provide experience with their construction. 

While much of the research is related to 
near-temi industry plans, the testbeds are also 
looking into the future. The testbed networks 
achieve the highest bandwidths possible, given 
the constraints of emerging industry standards, 
cuirent technology, and the time horizon of the 
program. The equipment used in the testbeds had 
to be such that it could reasonably be expected to 
be working in time to integrate the conqxments 
and begin testing the networks by the end of the 
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project. The s^lications are the most bandwidth- 
intensive possible, ''gigabit applications'' that 
require a full gigabit of bandwidth for each user. 
For the most part, these are distributed si^>ercom- 
puting applications that use the network to 
combine the processing power of multq>le siqper- 
conq)uters. 

The research is also related to the e}q)ected use 
of the network technology in the NREN environ- 
ment This emphasizes the use of Intemet proto- 
cols with the new fast packet switching technolo- 
gies, because the NREN program is linked to the 
evolution of the Intemet In addition, supercom- 
puter-based implications of the type being investi- 
gated by the testbeds will play an important role 
in the gigabit NREN. However, not all issues 
relevant to the future development of the NREN 
are addressed by the testbeds: because of the 
entasis on high-speed applications there is little 
woiic being done on plications that will be used 
outside the stq)ercon:q)uter community. Nor is 
there significant work being done on topics 
related to the growing size and complexity of the 
Intemet (see ch. 2, p. 26, and ch. 5, p. 70). 

Given the objective of demonstrating the feasi- 
bility of the emerging network design concepts, 
the testbeds are emphasizing the construction of 
working networks— nf^uch of the prior network 
research used modeling or simulation in ^ 'paper 
studies.'* Because there is little real experience 
with broadband networks, these models and 
simulations are based on assumed traffic patterns 
that may not be accurate. The testbeds are 
addressing this problem by building test networks 
and investigating both network and s^lications 
research simultaneously. The s^lications will 
provide a source of traffic with which to test the 
network conqK>nents and protocols. 

In addition, there is a focus on overall systems 
performance. The overall performance of a net- 
woik depends on how well the individual compo- 
nents work together, not solely on the perform- 
ance of any single component. In the past, 
researchers have tended to focus on the design of 

individual conqxments; for example, some have 
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looked mainly at switch design, others at trans- 
nussion systems, and others nt protocol issues. In 
part, this has been due to the conq>lexity of 
organizing research programs such as the testbeds 
that draw on the coIlat)oration among several 
disciplines. 

TliefiveCmitesa)edsareAURORA,BLANCA, 
CASA, NECTAR, and VISTAnet, and arc dis- 
cussed in more detail in boxes 4-A to 4-E. The 
sixth testbed, MAGIC, is described in box 4-F. 

I Testbed Design 

Each testbed is building a high-speed network 
that addresses wide area networking issues. The 
networks connect three or four sites — ^industry 
research laboratories, universities. Federal labo- 
ratories, and supercomputer centers — separated 
by anywhere from about 30 to many hundreds of 
miles. The focus on wide area netwoiks provides 
a realistic testbed for the agency backbones and 
the public switched network. In the past, much of 
the research done on advanced networks has 
involved small * 'local area networks.** These 
served to demonstrate the basic concepts and 
could be investigated by a small research group 
within a laboratory. The development of high- 
speed wide area networks is much more difficult, 
both technically and organizationally. 

The testbed networks if^Doci the basic technol- 
ogy trends outlined in the previous chapter. The 
networks all use optical fiber transmission and 
fast packet switching. There is major emphasis on 
the use of the telephone companies* Asyndiro- 
nous Transfer Mode (ATM) concept— five of the 
six testbeds 'ise ATM in some fashion. One of the 
testbeds also uses Packet Transfer Mode (PTM), 
a second kind of fast packet switching, and is 
investigating the relationship between ATM and 
PTM. Industry standard equipment is used wher- 
ever possible — the transmission links conform to 
the current version of the Synchronous Optical 
Network (SONET) standard, and the switches and 
other components that process the ATM cells 



conform as closely as possible to the current 
versions of the international standards. 

In order to focus on the systems issues, an effort 
was made to draw on con^>onent development 
work that was already underway when the testbed 
program started in 1990. Hus would limit die 
extent to which components had to be specially 
developed and allow more time to experiment 
with protocols, applications, and other issues 
related to the operation of the overall networic. 
Because fiber optic technology is the most 
advanced part of the system, the testbeds are able 
to use early production models of SONET trans- 
mission equipmrat, operating at 622 Mb/s or 2.4 
Gb/s. The switches, on the other hand, are mainly 
prototypes, as are the interfaces between the 
con^uters and the netwodc:s— before the testbed 
work focused attention on the issue of intercon- 
necting different network elemrats, network in- 
terfaces received less attention than such areas as 
switch or protocol design. 

At each testbed site are computers, switches, 
and network equipment. Computing resources 
available on the testbeds include workstations, 
vector superconq)utcrs, massively parallel super- 
conq)uters, and some specialized processors. In 
some cases this equipment is connected direcdy 
to the wide area network; in other cases it is 
connected through a local area network. The local 
area netwoiks are using newly emerging gigabit- 
per-second standards such as the supercomputer 
community* s High Performance Parallel Inter- 
face (HIPPI) or pre-standard experimental tech- 
nologies. A number of different interface devices 
are being developed to handle the conversion 
between the local area and wide area network 
protocols, especially the fflPPI to ATM conver- 
sion. 

Of particular interest is the investigation of the 
use of networks to enable collaboration between 
scientists and bring to bear increased processing 
power on a scientific simulation. Many of the 
applications also use the network to support 
visualization or interactive control of a simulation 
executing on a distant computer. Scientists and 
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Box -AURORA 



Figuro 4-A>1— AURORA 




SOURCE: Oflic« of Technology As««Mn»nt 1993. 



The AURORA network links four sites in the 
Northeast: the University of Pennsyivania in Philadel- 
phia; Bel Communteatkm Research (Bettcore) in 
Morrisiown, NJ; BM's TJ. Watson Research Center, 
in Hawthorne NY; and the Massachusetts institute of 
TtoChnology (MPr). in Cambridge. MA (figuMi 4.A-1). 
Bellcore Is the research arm of the Regional Bell 
Operating Companies (RBOCs) that provide local 
telephone servk^e in much of the United States. 

The testbed sites are connected by 622 Mb^s 
SONET channels. The transmisskx) fadiities are 
provided by three different carriers: interexchange 
links are provided by MCI, local exchange links to 6M 
and MIT are provkJsd by NYNEX, and kxal exchange 
lihks to the University of Pennsylvania and Bekore are 
provkJedbyBeNAtlanlks. 

Each node wlH have experimertal fast packet switches, whk* can either route tra^ 
on the teslbed site or to another node. The kxal area networitt wi« then distribute tiaff fc to wori^tattons. vkleo 
monitors, and other devk»s, A number of network interfaces have been built to al^ 
to the k>cal area netwoiks and SONET transmission links. BeWcore and BM are also supplying equipment for use 
in muitimsdiaand vkSeooonferenctng appik^ations. 

AURORA is uraque in two respects. First, it wiH emptoy two different switehing technotogies. Bettcore is 
contributing an ATM switch, based on the telecommunkations industry standard that uses small, fixed length 
packetscattedcells.BMiscontributingaswilch based onasecondfaslpacte 

Transfer Mode (PTM) {part of BM's "plaNET network architecture). The PTM switch was designed to support a 
network architecture based on variable sized packets; it can. however, also handle ATM ceHs. 

One of the research issues will be to compare the two types of switehing technotogles and to exptore ways 
in whksh the two technotogles can work together. In the current Internet networia based on a wkJe variety of 
underiying technotogies are used. Because both PTM and ATM may be used in future networks, it is important 
togain understanding of how trafffccouW best be exchanged between these two networiw. This wortc represents 
an Initial step towards gIgaWtinternelwortdng. 

AURORA is also unkjue in that It is not Investigating distributed supercomputing applk»tions. Instead, it 
emphasizes experimsntatton with high-speed "multimedia" appltoattons. Because vWeo streams do not in general 
require a fui gigabit of bandwWlh. one concept Is to deliver a gigabit stream consisting of a large number of 
medkjnvbandwkAh vWeo signals. For example, the letworic couW be used to support an electronto classroom in 
whwh a user couki select from different views of a classroom dsmonstratton. 

SOURCES- B*trM«k ^ "Gigabit NttworUng fUt^roh at Btloor*;' IEEE N»Mw*, vol. 6, No. Z March 1992, pp. 42^S: CWon •tmU 
••BandwkSh M^n»9tt^t and Coooattion Corrtfol in plaNET" IEEE ConmMMbotw, vol. 29. No. 1 0. Octebtr 1991 , pp. 54^. 



Other researchers arc developing applications in a 
number r * • arcas» such as climate modeling, 
chemical modeling, and space science. Because, 
in the long run, scientists will want to develop 
applications without having to learn all of the 



details of the network and computers' operation, 
a number of modules and programs are being 
developed that simplify the task of applications 
development in a distributed computing environ- 
ment. 
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The protocols generally confonn to the existing meetings on specific technologies. In addition, 

Internet protocols, the protocols that will be the there have been annual meetings, which include 

most widely used in &e NREN. The use of attendees from a wider group than just the testbed 

well-understood, standard protocols also allows participants, such as workstation manufacturers 

implications researchers to concentrate on appli- and government agencies, in an attempt to relate 

cations development The testbeds will provide a the testbed research to other industry activities 

way to test the behavior of the latemet protocols and the broader NREN program, 

in high-speed networks and to explore their use in One of CNRI's main contributions has been to 

a fast-packct-switched environment. However, ensure the participation of the carriers and other 

the testbeds will also be testing a number of industrial partners. Participation of industry is 

experimental protocols that may perform better essential to meeting the research goals of the 

wth new network technologies. This research project. First, the expertise required to develop 

may serve to test ideas that will be incorporated many of the components required for high-speed 

in the Internet protocols in the future. network research is only available in industry. 

These components are complex, and their devel- 
opment involves the fabrication of custom inte- 

I Testbed Organization grated circuits and high-speed circuit design. 

One of CNRI's key roles has been to assemble Second, industry involvement has lowered the 

the testbed teams. The testbeds draw on research- cost to the government of the program. The 

ers in industry, universities, superconc^uter cen- con^Mjnents developed by industry and the trans- 

ters, and Federal laboratories. Some researchers mission edacity between the testbed sites have 

within the groups have experience with tradi- been contributed at no cost. Because of the 

tionai telecommunications issues, while others contributions of industry, ARPA and NSF's 

are more familiar with issues related to the support through the cooperative agreement with 

Internet or supercomputer networking. The CNRI only covers a small part of the total cost of 

testbed research is necessarily multidisciplinary. the project.^ 

In particular, each research group involves both There arc a number of issues associated with 

network and applications researchers. The appli- the participation of industrial partoers in the 

cations researchers have experience with super- research venture. Some of these concerns are 

computers, visualization, griq)hics, and a variety legal — diere are antitrust issues, and further 

of scientific disciplines. Network researchers regulatory constraints govern the telecommunica- 

draw on expertise with switches, transmission tions industry. Another factor has been the 

equipment, protocols, signal processing, and com- competitive relationship among the testbed partic- 

puter architecture. ipants— while participating in the same research 

While regular meetings are held between CNRI project, they are also con^titors in various lines 

and program managers at ARPA and NSF, most of business. For example, the wider use of more 

of the responsibiUty for the management of the sophisticated telecommunications industry serv- 

testbed program lies with CNRI. For example, ices may not necessarily be in the interests of 

one of CNRI's functions was to help develop the companies that have emerged to offer computer 

specifications for the transmLcsion equipment that networking services. 

would be used in the testbeds. CNRIhas also been Moreover, some aspects of the research do not 

responsible for maintaining the technical direc- reflect industry priorities. Because of the cost of 

don of the project, and has held a number of true gigabit access, it has been estimated that it 



^ Stir, op. cit., foooxMe t. p. 1 18. 
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Lawrence 
Berkeley 
Laboratorie: 



UC Berkeley 



B0X4-B-BLANCA 

The sites on the BLANCA network Figure 4-8-1— BLANCA 

are more wi(My separetsd than those of 
the other tesbeds. The netwoik links 
AT&TBeM Laboratorias In New Jersey, the 
Unh/ersityofWIsconsinandthaUn^ersity 
of Minols, and the Univarstty of Cairfornia- 
Berkeley and Lawrence BecMay Labora- 
tories (figure 4-B-1).Becauseofthe cost of 
gigabit transmissk)n fadlities, high-speec! 
links will Initially be used only for some 
parts of the networie The aoss-country 
segments of the natworic wil use 45 Ift/s 
T3 links. While this bandwklth is not 
suffkdent for distributed supercomputing 
appikatk)ns,theBLANCAnatwori(wiHstin 
provkie an environinert for rasaarching the behavky of new protect 

BLANCA is an ATM-based networie The experimental ATM switches and other hardware are being supplied 
by ATei Bell Labs, ths indu^^^Hal partner for BLANCA. BLANCA buikis on preexisting research relationships 
between BeH Labe and the University of Wisconsin, University of lilinois, and UC-BeriwIey. The switches are 
designed in such a way as toakywresearchersat the uritverdties to 

with computer programs that implement their experimental protocols. The networie research interests are similar 
to those of others kx)king at ATM-based networtcs, such as oongestfon control and the behavfor of Internet 
protocols in an ATM-based networie, and is being carried out primarily at UC-Berieeley, the University of lUinois, 
and the Unh^slty of Wisconsin. 

BLANCA emphasizes distributed supercomputing appllcatfons, as do most of the other testbeds. The 
appikatkxis woric is being done at the Natfonal Center for Supercomputing Applkations (NCSA), the University 




SOURCE: Offic* of Tedinok>gy Ass«ssm«nt. 1993. 



would not be generally available to commercial 
customers until about 2(X)5.^ Much of the re- 
search agenda focuses on higher bandwidths and 
more specialized qjplications than are expected 
to have near-term commercial significance for the 
telecommunications industry. Industry planning 
is oriented more towards medium-bandwidth 
multimedia applications — applications that re- 
quire more bandwidth than can be supported by 
current networks, but significantly less than the 
gigabit/second rates required by the supercom- 
puter community. For example, the telecommuni- 



cations industry's ATM-based Broadband Inte- 
grated Services Digital Network (B-ISDN) stand- 
ard envisions 155 Mb/s channels to each customer 
in the near term. Furthermore, many of the 
interesting issues related to the operation of fast 
packet networks can be studied with lower 
bandwidth networks, although a few issues may 
only become jqjparent at gigabit/second speeds.'* 

TESTBEO PROGRESS 

The major research results of the testbeds arc 
still to come. Most of the networks are not 



3 M Nkl Ransom and Dan R. Spears, ''Applicatioos of Public Gigabit Nctworkf IEEE Network, vol. 6, No. 2. Maith 1992. p. 30. 
* Leooard Kleinrock, "Tbe Laiency/Bandwidtb Tradeoff in Gigabit Nctworki/* IEEE Communications, vol. 30. No. 4. April 1992, pp. 
36-40. 
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of Wisconsin, and Unvrsnos Berkatoy Laboraioriet. A significant part of the work involvas the da v topmant of 
software packagas and nmUas that mato it easier for sdanUste 

l=br example, NCSA has been devek)ping modules that handto many of the networtong functions; theee free 
sdenlists d the need to learn al the details of the networkfs operatk)n-4hey can ^ 
in their appiicaHons. Another project is developing a digital ti>^ 

piooessing of data-one of the programs that can be accessed by this digitai Ifcrary handtos visuaizatkMi 
processing, for example. 

The appHcatkm under development as part of BLANCA couM be vlevved as prototypes for the Qrand 
Chalenge problems to be investigated under the HPCC program 

they WIN require coMaboratkxt between geographlcaly dispereed researchers. The network and computing 
environmentoouU supportthis collaboration by provMingM^ 

levels researchers at NCSA have dsveksped a program that permits cottaborative investigation of data. It permits 
aresearchertohighllgttafsaturo in the data displayed onawork8tationsaeen;resear 
then see the same foature highlighted on their displays. 

The Grand Challenge problems will ale> involve very large data sets. Processing the data Into image form 
Is oomputattonaHy intensive, espedaliy when it is necessary to view the data interactiveiy. The Universtty of 
Wisconsin and NCSA are investigating the use of high4)andwkKhconnectk)ns from a sdentlsrs workstation 
supercomputer to provkle the necessary computationai resources for visualizatfcxi processing. 

A radio astronomy application being studied as part of the BLANCA project is tooking at issues involved in 
visualizing targe data sets. Arrays of radkitelesoopes collect the data, which is then sent through the network to 
asupercomputer. A user at a workstation connected through a high4)andwidth netwodc to the supercomputer can 
control the processing of the raw data into images, whk:h are then sent through the network to the w^ 
display. 

SOURCES: BUNCA Annual Report; CtwiM E. CaSin, 'In Smuc^ 
1992, pp. 42-«1; Urry Sflimand Chaikc E. Cafttt, nyMaoomputing/ 
Carolyn Duffy MafMn/t2i0abftNatwQffc«tSiggra 
p.1. 



expected to be operational until the third quarter 
of 1993. After the initial planning stage, the 
testbed work during 1990-92 was mainly devoted 
to conq)leting hardware development for the 
switches and interfaces, theoredcal and simu- 
lation work on protocols, and development of the 
applications software and tools. The next step will 
be to integrate these components into a working 
network; this will occur in stages over the next 
few months. As the networks become operational, 
researchers will be able to begin addressing the 
unresolved research questions. 

Work on the testbeds has been proceeding 
more slowly than expected. It had been hoped that 
there would be about a year to experiment with 
functioning networks before the end of the 

Q 
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original 3-year program. Because most of the 
networks were not yet operational, a IS-month 
extension was granted in order to allow time to 
look at network-level issues and test the networks 
with ^plications. The delay has been due to the 
late availability of the transmission equipment 
and problems with the fabrication of switches and 
other hardware components. 

I Component Development 

During the first 2 years of the testbed project, 
the participants have been working mainly on the 
completion of the individual network compo- 
nents. The SONET transmission equipment has 
taken longer than expected to become available, 
but is currently being tested and, in some cases, 
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Box 4-C-CASA 



Th# CASA network connects four sites^he San 
Diego Supercomputer Center, Los Alamos National 
Laboratory, and the Jet Propulsion Laboratory and 
Caltechin Pasadena (figure 4-C-1). The lir*s between 
the tesibed sites are provided by MCI, Pacific Bel, and 
US VMst Also participating Inthe project is the UCLA 
..jnospheric Sciences Department 

The miin emphasis oT the CASA project is on 
applications deveiopmenh-using the networkto com- 
bine the processing power of multiple supercomput- 
ers. The three main applications under Investigation 
are modeling of climate change, modeling of chemical 
reactions, and interactive visualixation of datadescrib- 
ing the Earth's crust These applications aU require 
more processing power than Is avaliablefromasingle 
supercomputer. For example, the CASA climate 
change model is limited to simulations of a decade or 



Figure 4-C*1--CASA 




San Diego 
Supercomputer 
Center 



SOURCE: Offio* rf Tftchnology AsMtsm*nt 1993. 



less In t';^ curort computing environment One of the research issues concerns the partitioning of a computation 
among r itiple supercomputers. While in theory multiple computers can be combined in order to solve a problem 
more quIcWy, the best way to allocate parts of the computation to different computers depends on a number of 
factors, ft may be necessary, for example, to arrange the computation in such a way as to hide the time it takes 
for data to travel between the computers-even when traveling at speeds dose to the speed of light data can take 
a significant amount of time to travel from one computer to another. Efffcient Implementations wouW arrange the 
computatkw so that the supercomputer vroukJ be able to proceed vwth ot^ 
arrive. 

Eff fclent implementations may also be able to take advantage of the strengths and weaknesses of different 
supercomputer architectures. For exanipie, researchers have determined that the dlmate modeling applteatwn 
can be splitintoanumber of parts, each of vvhfch executes fastest onapartkxilarkindd 
of the simulatton that models oceans coukJ be executed on a massively parallel computer, while the atmosphere 
wouM be modeled by a more conventionai vector supercomputer. The two models woukJ then exchange 
temperature infamation and other dataat regular irrtervais. The CASA netwo^ 

of supercomputer architectures, induding different types of Cray Y-MPs, and massively parallel machines from 
Thinking Machines and Intel. 

SOURCES: CASAGIgaWt NrtworkT««tt)^. brochurt; Charts* E Cttlttt. "In S^rch of Gigabit Appllcmtlontr IBBB Communication; 
vol. 30, No. 4, April 1992. pp. 43^; EH3»b«th Smith. "NREN-Comput^r Bf^numi of th# Futur#." Gsihor/Sc^tlfr, p. 3. 



installed in the carrier networks. WhUe the 
development of this equipment did not present 
any research issues, its availability was subject to 
factors affecting vendor development schedules. 
In part, these were hardware and software engi- 
neering issues. However, other factors have 
played a role; for example, the SONET equipment 
is very expensive and i. is **high end" compared 
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to the equipment that vendors expect to be the 
bulk of early demand. In addition, some aspects 
of the SONET standard have taken longer to 
complete than expected. 

The development of the switch prototypes had 
been underway when the testbcd work began, but 
in some cases the testbcds presented a more 
aggressive research target. The interfaces that 
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B0X4-D--NECTAR 

TTwhECTAR nat«K)fkoonit8tsor«high-«pMd Ifritthatoonnectt two iociii aiM network Mttton 
Univirsityand tha Pittsburgh SuperoonH)utir CgnK^ 
BiMoora and CMU ar« collaborating on tto ha^ 

OnaaraaofraMarohfbcumontha Wiiconnactibn of higtup— d local and wkto awa natworka, Tha 
fCCTARk>calaraanabM)d($oonrbrmtoanawtta 

the wkJa aroa connactlon batvfoan thatwosltaswI^uiaATMcalisovara SONET link. Rasaarch on thia 
oonHguratkm ia important bacausa HIPPi is axpactad to ba wkMy ^ 
tha taiaphona oompanias ara axpactad to dtptoy ATM- and S0^^ 

tha intaractiona batwaan tha two kinds of natworks is axpactad to support futura distributad suparcomputing 

applkatk)ns.Aspartoftharasaarch,aspadalintarfaoacteuitthatconv^ 

formats is baing davak)pad. 

Anclhar araaof rasaarch is tha implkations of nswhigh-speadnatwo^ 
computarswaranotdasignadinsuchawayastooptimiza tha task of moving data to and from tha nstwode 
Appikatkm may not baaUo to taka advantaga of improvamants In tha natw^ 
in tha intsrnal hardwara or systams softwara of tha oomputar. Tha IC^ 
approachastodalivaringdatafromthanatworktoapplk»tkmathl^ 

constructk)n of spadal ''inlarte^'* cirGuits that f raa tha computar's main procasaor of soma of tha protocol 
procassing tasks. 

Softwara davatopmant for tha appikations has baan procaading in paraiM wKh tha davatopmant of tha 
hardwara componants. Tha appik»tk>ns hava baan tastad in tha kxai anvkonmantp and it is hopad that tha 
applk»tk)ns can ba mada to work on tha gigabit natwork with a minimum of modificattons whan it baoomas 
oparational. Tha applk»tk)ns ara distributad suparoompuUng applkatkm that taka advantaga of tha oombinad 
powar of muitipla supercomputers to reduce tha time needed to solve a problem. The NECTAR netwod( will 
connect a number of different computers, inckiding the worksuttons. tha experimental iWarp parallel computer, 
and a variety of machines at PSC. 

SOURCES: NECTAR annud rtport; H.t Kung, 'HSIoablt U)cid Atm NtlvMKki: ASytt«nt P«^fMctiv»." i^' CotnmurioiMorM, vol. 30 
No.4,April1Se2.p.7S. 



connect the computes to tbc network, or connect 
local and wide area networks, were designed 
specifically for the testbeds. Delays in the devel- 
opment of these components are due to their 
conq)lexity and the demands of high-speed elec- 
tronic design. A switch, for example, consists of 
a number of subsystems, each with a large number 
of standard and newly designed integrated cir- 
cuits.^ At the end of 1992, the custom integrated 
circuits had been designed, and most of the 
subsystems tested. The PTM switch to be used in 
the AURORA testbed has been completed, and 



the other switches and interfaces should be 
completed shortly. 

To the extent possible, much of the work on 
protocols has been proceeding in parallel with the 
hardware development. This is expected to lead to 
fastCT research results once the networks become 
operational. Some of the work on protocols is 
conceptual and theoretical, and is done by simula- 
tion or by mathematically modeling the flow of 
data through a network. One of the main reasons 
for building the testbed networks is to test the 
assumptions that underlie these models and 



5 For t dcscripiioQ of the componentt of one prototype switch, sec Bienack ct il., "Glgibit Netwoiking Research at Bellcore,** IEEE 
Communications, vol. 6, No. 2, March 1992, p. 47. 
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Box4-E-VISTAnet 

one o( th« ViSTAnat objectives was to we emerging public network technotogy and '^^^^^^^ 
poe^^^switches^KJlSLission^ 
SrriCTk and are early productton models from ma^ 

•"^rsTrr^rrrz^^^^^ 
com^.':^d:r^^ 

h^desMtooed One olthese boards also has the capabilitytoconectdataontraff^ 
n^l^J^'^^modetefanetworkres^^^ 

^"Cr<r^tsr,«-ds.its^s«,a^ 

nn thm cteveiooment o» an application that uses a network of powerful computers to help doctors plan cancer 
r^J^t^^t^S^hesebeamsise^^ 

tSSI^Hdsang technotogy is th*t the tr«.tmsnt ^'^J-^^^^^^ 
dimBnsione-doctorsar»or<yabletokx*atthedistributk>nofradiatk)nonaWoft^ 

"^^AiirnmitaS^ i. t^t ^r^r^ process is "im«ac«ve." U.^ to^ 

iSSty is^^ or^Xr resolutkx^-flenerating a hlgh^solution image take, too kxig 

a naramatar such as beam strength, altowing doctors to examine a greater range of treatment plans. 

'^SJe^vrdSSXmlgesof^latkMidirt^ 
ahJS.S^to°^c«iXpra»s.^P^ 

Pix^Ptanes machine a special graphks processor devetoped at the Univorsity of North Carolina. A user at tM 
J^TiSSnVThe proposed beam strengths and ortentatton to a Cray supercomputer at 

ThS^^^S^i^^Sri graohfc^ at UNCCH. which generates the image data that show, the 

SrrLr^a3rmageJ:pe.mposedont^^^^ 

workstatton for display. Much of the software has been devetoped and tested on tow-peed versions 
^'^^iSJSJJlIiappltoattonisagoodexampte 

c^^^^^^nr^^r^ <'f«« «^ at the Schod of MedkSne at UNC^IH TN. 

SrrSes^JedevrtopmeTTauserinterfacette^ 

Sti« T^phiH^ms required to interactively generate 3-D volumes are themselves an 

important research area ^ . . „ , « 

sources: 0.nS.^.-..-V.ST^^''^;^'j;^-B;^^^ 
*; Tii,comnuMUo*lon,, vol. 10. No. 9. D*>«nb* 1»«2, pp. 1423-1420. 
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B0X4-F-4IAGIC 

Th« MAGK) tesbod is similar in many respo^ 
to pravida access to superoomputing rssources. As in the CNRI testbeds» there is oomidefabie involvemeit of 
industry, the Internet protocols wrfl be used, and the teiecx)^^ 
standaidi Ito SONET ami Anyi, The appttcetion that wilbet^ 
to the Department of Defense* 

The participants In MAGIC are the Earth Resources Ot>servation System Data Center, U.S. Army 
High-Performance CompuSnp Reeearch Center, the U.S. Army's Riture Battle Laboratory, U.& Geological 
Survey, Mnnesota Supercomputer Center, SRI Internationai, Lawrtnce Berkeley iJdboralory, U.S. Department of 
Energy, MITRE, Dtgit&l Equipment Corp., the University of Kansas, Sprint, Southwestern Bel, Northern Telecom, 
and Split Rock Telecom. 

The MAGIC netmric wiH connect four 
sites, the University of Kansas In Lawrence, 
Kansas, the U.S. Geok)gical Survey in Skxix 
Rdls, South Dakota, the U.S. Army's Future 
Battle Laboratory in Fort Leavenworth, Kansas, 
and the Minnesota Supercomputer Center in 
Minneapolis Minnesota (figure 4-F-1). In the 
first ptase of the project, the sites will be 
connected with point to point, 155 Mb/s or 622 
Mb/s SONET circuits* In the second phase of 
the project the network wilt use an ATM switch. 
The SONET and ATM services WiH be provktod 
by Sprint 

One of the research issues is the intercon- 
nectkm of different types of gigabit k)cal area 
networks. Three different types of tocal area 
networks will be connected through the ATM wkie area network. As part of the research effort, new modules will 
be built that convert from thd kical area network technotogy to ATM, and altow the interoonnectton of the different 
networks. 

The applicatton wiN investigate remote visualization of data drawn from a number of different sources. 
Informatton from a database at the U.S. Geok>gk»l Survey will be sent through the network to a massively paraHel 
supercomputer at the Minnesota Superoomputer Center. The supercomputer wil compute images based on this 
data, and send the image data through the network to the Future Battle Laboratory, where it wiK be displayed on 
a wori(station. The supercomputer provides the necessary processing power to select and view the Imeges 
interactively (see the discusston of the VISTAnet applk»tk>n In box 4-E). 

Thetestappikattonwillaltowthesimulatton of walking or ftyingthrot^ 
Army believos that f iekl off toers coirid benefit from this capability, and that the applkatton coukl be used for 
planning and educattonai activities. The landscape images are aeated from aerial images, satellite data, and 
geographk: eievatton data. Researchers will also study user interfaces to this type of applicatton. 

SOURCES: AntU Ta<f , **Sprtnt to Prowkto Syvto— for QARftk Rt— rch mr N tfmw k Wbrtdi vol. 9, No. 27, July 6, 1 SQ2. p. 9; TTm Wtooft. 
"Group Plolo Qigftbit Nttworttng.** ConwnutMhmWMk InltmitibrMit July 6, 1992, p. 35. 



Figure 4«F-1— MAGIC 
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simulations. The protocol lesearch also involves 
evaluating the behavior of existing networks like 
the Internet and writing software that will be used 
to program the switches, con^)uters» and inter- 
faces. 

Wod: on the distributed supercomputing apphr 
cations has also been proceeding in parallel with 
the hardware development. Much of the software 
development for the applications has been com- 
pleted. In many cases, it has been possible to test 
these applications to a limited extent using 
existing high-^speed local area networks or low- 
speed wide area networks like the Internet. Before 
writing the software, extensive analysis was done 
of the required computations, to determine how 
best to divide up the conq)utations among the 
multiple computers that make up the overall 
system. Other important software development 
has involved the development of user interfaces 
and software tools that would miake it easier to 
program distributed conq>uting applications. 

I Systems Integration 

The next objective of the testbed project wiU be 
to combine flie network components into an 
operational network. This will begin once the 
transmission equipment is in place and woric on 
the switches and other hardware has been com- 
pleted. The systems integration task will proceed 
in stages, beginning with the sinq)lest network 
possible, to minimize the nimiber of sources of 
possible problems. VISTAnet began the integra- 
tion process in the fall of 1992; the other testbeds 
should be in position to start this work by the third 
quarter of 1993. Over time, the networks will be 
expanued into more complex configurations. 

The issues addressed in the early part of the 
systems integration phase are the low-level de- 
tails of making sure that components designed by 
different groups work together or that a signal 
arrives in the format expected by a component's 
designer. These are the kinds of problems that are 



difficult to find when components are tested 
individually. For example, when the NSFNET 
backbone was upgraded ftom Tl to T3 links 
during 1990-92, the technical staff of the 
NSFNET backbone provider found that some 
conq>onents did not behave as expected under 
certain conditions, or unexpected traffic patterns 
required changes to the software and hardware.^ 
Similar problems will probably be encountered as 
the testbeds begin to work through this stage with 
prototype or newly developed network compo- 
nents. 

I Network Research 

One research issue concerns tue algorithms 
used to control fast packet networks. These 
mechanisms are used to enable fast packet net- 
works to si^rport many different kinds of services 
using the same links and switches; one of the 
weaknesses of traditional packet networks was 
that they could not guarantee the kind of perform- 
ance required for real-time s^lications sucn as 
video. In a fast packet network, software in the 
users' con^uters and in the switches will have to 
cooperate in managing the flow of traffic through 
the network in a way that siq)ports all kinds of 
services. There have been many different mecha- 
nisms proposed for accomplishing this objective, 
but it is regarded as the most difficult problem 
with fast packet networks. The testbeds will 
provide an opportunity to test different control 
algorithms. 

Another research issue is related to the devel- 
opment of distributed supercon^uting applica- 
tions. In these applications a computation is 
divided among multiple supercomputers; the 
network is then used to exchange data as the 
computation proceeds. Deciding how to allocate 
different parts of the con^>utation to different 
supercomputers is a difficult problem. The best 
strategy depends in part on the characteristics of 
the netwoiic and the strengths and weaknesses of 



* **T3 Upgrades to ANS Network New Completion," ANS Update, vol. 1. No.t, l99l. p. 1. 
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different computers connected to the network — 
for example, some parts of a computation may be 
executed fastest on a massively parallel com- 
puter, vfbUt other parts may run fast^ on a vector 



computer. In order to maximize processing power, 
conq)uters should not be idle while they are 
waiting for one of the other con^uters to finish its 
task or for data to be sent through the network. 
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The networking component of the High Performance 
Conqputing and Communications (HPCC) Program funds 
both research on gigabit technology and the deployment 
of this technology in the National Research and Educa- 
tion Network (NREN). One of the NREN's roles is to provide 
additional experience with advanced netwodc technologies 
before they are deployed nK)re widely in the national information 
infrastructure. However, the testbed research will also be qiplied 
directly to other netwoiics, such as the common carriers' public 
switched network, without intermediate deployment in the 
NREN. 

APPLICATION TO THE NREN 

There is no overall NREN development plan; however, the 
National Science Foundation (NSF) is to coordinate the evolu- 
tion of the Federal agency networics that are the core of the 
NREN.^ During 1992, NSF, the Department of Energy (DOE), 
and the National Aeronautics and Space Administraticm (NASA) 
announced plans for the future development of their networks.^ 
Based on these plans, the next-generation agency networks will 
likely be similar to the testbed networics, with an emphasis on 
Synchronous Optical Network (SONET) fiber optic transmission 
and fast packet switching. These broadband technologies are 



1 Office of Sckace and Tbcboology Policy, "Grand Chalknces 1993: High 
Parfofinaooe Compotiiig and Commonicatioos,** p. 33. 

2NatiQCMl Science FboDdatioii, "Public Dnft Network Acceas Point Manager/ 
Roating AndkMity aod Very Higlh Speed Backbone Network Services provider for 
NSFl^ and ttie NREN Ptognm,** Jane 12, 1992; Jamet E Ldtfttoo, Manager of 
Networks^ and Ei^iiMring, National Energy Reaearch S ttp q t omp u t.jr Center, Uw- 
rence Uvennore NMiooal Laboratory, "ESoet Fait-Packet Services RMpuranents 
Specificjrion DocuMot,** Feb. 20, 1992. 
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being studied in a large number of research 
programs, but the testbed research is imique in its 
emphasis on building wide area gigabit netwoiks 
and testing them with applications. 

I Agency Plans 

The Federal agencies will not build their own 
* 'private' * networks, but will obtain services from 
a netwoiic service provider. In effect, NSF, DOE, 
2nd NASA will act as early, large customers for 
advanced services. While iudustry has developed 
the switches and transmission equipment required 
for advanced network services, the agency back- 
bones will be one of the first opportunities to 
integrate these components into a system that 
provides services to real users. Users of the 
agency backbones are knowledgeable about net- 
working and will assist in integrating new net- 
work services with computers and applications to 
create useful systems. 

The agency backbone services could be pro- 
vided by a number of different organizations — 
the carriers, con^uter companies, or some of the 
emerging providers of commercial Litemet serv- 
ices — or consortia. Provision of services for 
agency backbone netwoiks provides valuable 
experience that the networic operator may be able 
to translate into earlier availability of advanced 
services on a commercial basis.^ For prospective 
players, the decision to participate in the provi- 
sion of services to the agency networks weighs 
the experience gained and long-term strategic 
considerations against the cost of providing the 
service, which is greater than the money available 
from the Federal agencies. 

To help stimulate market interest, DOE and 
NASA had originally decided to combine their 
NREN-relatcd programs. A single supplier would 
have provided network services to both agencies, 
connecting sites such as DOE*s Los Alamos 
National Laboratory or NASA's Ames Research 



Center. However, the General Accounting Office 
(GAO) overturned DOE*s choice of contractor in 
March, 1993 (see ch. 1, p. 7). The steps that the 
agencies will take in response to this decision 
were still xuiclear at the time of publication, but it 
is possible that DOE and NASA will now decide 
to proceed separately. The propurement process 
has been significantly delayed, and will likely not 
be completed before the fourth quarter of 1993. 
Before the GAO decision, NASA and DOE had 
planned to begin connecting sites to the new 
network in mid-1993. 

NSF issued a draft solicitation for its next- 
generation network in mid- 1992. NSF plans to 
publish a final version T the solicitation and 
award a cooperative agreement during 1993. The 
new netwoi^ is scheduled to begin operation in 
mid-1994. NSF's plans for the evolution of its 
network have greater implication for the evolu- 
tion of the NREN and the Internet than do those 
of DOE and NASA, The current NSFNET back- 
bone carries much more traffic than the other 
agency backbones ^ and serves a broader range of 
users. However, many of those users will not be 
able to use the next-generation backbone. 

The new NSF networic's primary purpose will 
be to connect the NSF supercomputer centers, 
enabling advanced distributed supercomputing 
plications. By contrast, today's NSFNET back- 
bone is a * *general-purpose' * network that carries 
all types of research and education traffic. NSF 
envisions that in the future routine research and 
education traffic will be handled by commercial 
providers, not by the agency-operated backbone. 
There aze a number of emerging commercial 
providers, and the network technology required to 
support routine traffic is sufficiently stable and 
reliable. This strategy would also free capacity on 
the backbone for experimental s^lications. 

The transition to the new environment result- 
ing from the changed role of the NSFNET 



3 Am H. lindmooi, "Sprint BUsU Ahetd With ATM Deployment." Telephony, voL 223, No. S, Aug. 24, 1992. 
* Stephen S. Wolff, Director, EHvition of Networking and Comcnuucariom Rctcttch and Inftmrectnie, NMionil Science Fdondaiion, 
testimony «t bearings before tbe Hooae Subcofunittee on Science, Mar. 12, 1992, Serial No. 120, p. 155. 
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backbone will require careful maoagement to 
ensure stability. NSF*s plan will affect signifi- 
cantly the existing three-level hierarchy of the 
NSFNEX The regional netwoiks were designed 
to provide connections to sites on the current 
backbone, which in turn provides inter-regional 
connectivity. Under NSF*s new plan, the back- 
bone will serve many fewer sites and will no 
longer play the same central role in research and 
education networking. The regional networks 
will have to make new arrangements for intercon- 
nections and will be operating in a more con^ti- 
tive environment 

I Agency Backbone Technology 

The collaborative nature of the testbeds makes 
it mv.-e likely that the network tedmologies 
developed by industry will be suitable for opera- 
tion in the agency backbone environment The 
testbeds are emphasiadng the technologies* use 
with the hitemet protocols used by the agency 
networks, and are stud3ring the interaction be- 
tween fast packet networics and supercomputer 
network standards and s^lications. In addition, 
they emphasize the gigabit bandwidths required 
to support the Grand Challenge s^lications that 
are a key component of the overall HPCC 
program. The involvement of the carriers in the 
research program may also lead the earners 
toward a more active role in providing NREN 
services. 

While the plans for the evolution of the agency 
backbones are consistent with the target estab- 
lished by the testbeds, the agency networics will 
initially operate at lower bandwidths than the 
testbeds. The agency backbones will incorporate 
more of the technology from the testbed research 
as they evolve over time to meet the goal of the 
gigabit NREN. However, some issues cannot be 
addressed by the testbeds, or may be discovered 
only as the agency networks are deployed. Many 
of hiesc issues are related to the more complex 



topologies (greater number of sites), larger num- 
ber of users, and more diverse sources of traffic 
that will be present on the production networks. 

TRANSMISSION TECHNOLOGY 

The agencies envision the use of SONET 
equipment similar to that used in the testbeds, and 
have indicated that they hope to use 155 Nfb/s 
SONET equipment in 1994 and then upgrade over 
time to 622 Mb/s (the next transmission rate in the 
SONET family) by 1996, the ffigh Performance 
Computing Act's target year for the use of gigabit 
links. The 622 Mb/s rate, less tiiian a full gigabit 
per second, is somedmes referred to as a ' ^govern- 
ment gigabit**^ 

The rate at which the agency backbones will 
evolve d^nds on the timely deployment of a 
high-baMwidth SONET transmission io&astruc- 
ture by the earners. While much of the carriers* 
existing network uses fiber, SONET transmission 
equipnoent is required in order to support com- 
puter networking above the current T3 rates — ^it 
allows the fiber to be configured to cany high 
bandwidth channels. However, this equipment is 
extremely costly at this time and the carriers* 
deployment schedules have been slipping from 
earlier estimates. 

The testbed networks will have also provided 
experience with the connection of supercomput- 
ers to higjh speed netwoiks. ''High end** users 
will require fiber links coimecting their sites to 
the NREN. Only fiber is able to carry the large 
amounts of data needed for supercomputer-based 
applications. The testbeds 2^ one of the first 
large-scale deployments of SONET to end-users, 
and considerable work has been done on interface 
devices to connect supercomputers and high- 
speed local area netwoiks to fast packet switched 
networks. However, widespread use of high- 
speed netwo^ will depend in part on the degree 
to which con^uter companies design their work- 
stations to be fully integrated into a high-speed 
network. Today, bottlenecks encountered in mov- 



3 CwpMicr ct «!.. " Whm Are We WiUi OigaUtt?" IEEE Network, vol. 6, No. 2, Much 1992, p. 10. 
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ing data firom the network into the computer's 
memory, where it can be used by the applications 
software, can limit the performance of the overall 
system. 

SWITCHES 

The nejct-generation backbone networks wili 
use fast packet switching technology similar to 
that used in the testbeds. Initially, the switches 
will not be as sophisticated, because of the lower 
link bandwidths. The network operator's choice 
of switching technology, from among those being 
investigated in the testbeds and elsewhere, de* 
pends in part on long-term strategic considera- 
tions. If a carrier were to provide services for an 
agency network, it would probably use Asynchro- 
nous Transfer Mode (ATM) switches. ATM has 
been chosen as the foundation for the future 
development of carrier networks, and the provi- 
sion of services for the agency backbone would 
provide an opportunity* to gain experience with its 
use. Other providers might also choose to use 
ATM switches, or strategic considerations may 
lead to the choice of an alternate switching 
technology. 

The DOE Reqest for Proposals issued in early 
1992 !?pecified the use of fast packet * *cell relay* * 
technology. **CeU relay*' is a term used to 
describe both ATM and Switched Multimegabit 
Data Service (SMDS), a data conununications 
service developed by the telephone companies. In 
the summer of 1992, DOE and NASA selected a 
contractor that proposed to use ATM. This 
DOE/NASA program would have been the first 
large-scale deployment of ATM. One of the goals 
of DOE and NASA is to encourage the develop- 
ment of commercial services by evaluating and 
demonstrating emerging technologies such as 
ATM. The agencies* effectiveness in performing 
this function may be reduced by any further 



delays resulting from GAO's decision overturn- 
ing their choice of contractor. 

The National Science Foundation* s draft solic- 
itation describing the evolution of its backbone 
network did not specify a particular type of 
switch.^ NSF will allow prospective biddors to 
propose their choice of switching technology. 
The most likely option that would be proposed 
would be an ATM-based sqpproach. Another type 
of fast packet technology, such as the PTM 
s^proach developed by one of the participants in 
the Aurora testbed, might also be used. The 
s^proach of ' 'overlaying* * an Internet network on 
a network that uses fast packet technology is not 
unique to ATM. However, ATM has broad 
support from industiy standards committees. 

OTHER NREN NETWORKS 

The regional networks and other commercial 
providers of Ihtemet services may also carry 
NREN traffic. Operators of these networks are 
faced with the same technology choices as those 
for the backbone networks. However, because 
miany of these networks will require lower band- 
widths than the backbones, diey may continue to 
use **router-bascd** networks or use new **prc- 
broadband** services being offered by the carriers 
and other service providers. Two examples of 
these pre-broadband services are Brame Relay 
and SMDS.*^ These are packet switching services 
that can also be used to carry Internet traffic (see 
ch. 2, p. 34). Because the Internet protocols are 
able to hide differences in network technology 
from the users of the network, the NREN*s 
networks can be based on a variety of different 
technologies. 

Campus networks and other networks based 
primarily on local area networics wiU also become 
more capable. Local area network research is not 
currently a focus of the testbeds, although the 
interconnection of local and wide area networks 
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is being studied One of the most important trends 
in local ax^ea network design is that that is a 
growing amount of support for ATM-based local 
area networks and products for ATM local area 
networics are beginning to appear. Other kinds of 
higji-bandwiddi local area network standards are 
also being studied by standards committees. 

I Appiications 

Because of the emphasis on gigabit applica- 
tions, the testbed applications research is primar- 
ily £^licable to high-end users of the NREN. The 
testbeds have been one of a small number of 
research programs to address supercon^uter- 
related networking issues. These q)plications are, 
in general, of little concern to industry and would 
receive less attention without the testbeds. The 
testbeds' gigabit applications research will have 
important inq)acts on the overall HPCC initiative. 
Distributed siq)ercomputing may be an important 
tool for bringing more processing power to bear 
on the Grand Oiallenge problems. In addition, the 
Grand Challenge teams will be scattered about the 
country and could use networks to siq)port 
collaboration. The sizes of the data sets used in 
Grand Challenge problems will be very large, 
requiring high-bandwidth networks to move them 
from place to place within a reasonable period of 
time. 

High-speed network si^)port of supercom- 
puting is important to the missions of the NSF 
supercomputer centers and the Federal laborato- 
ries. Led by testbed participants, the NSF super- 
conq)uter centers have proposed a concept that 
would make use of the distributed siq)ercom- 
puting ideas investigated by the testbeds.^ They 
envision a ''metacenter'* — the use of the new 
high-speed backbone to integrate the computa- 
tional and iatellectual resources of the supercom- 
puter centers.^ In effect, it would be possible for 
the four supercomputer centers to act as a single 



center, distributing a computaticm amcmg several 
machines as the conq)utation required. 

High-end users of the agency backbones are 
only part of the user conmiunity addressed by the 
NREN program. Few users will bave access to a 
fall gigabit/second of bandwidth, and die siq>er- 
corrq)uta: applications studied by the testbeds are 
by definition highly specialized. For most users 
the primary result of in^^roving network aq>abil- 
ity will be better perfomuuice with existing 
applications and the wider use of video and 
image-based conununications. Because these ca- 
pabilities may have considerable significance in 
commercial s^lications, much work is being 
done on these types of plications by industry. 
Some types of s^lications development, how- 
ever, may require added support Legislation 
iatroduced in the 103rd Congress (S.4 and H.R. 
1757) seeks to e^cpand support for sq[>plications 
development in a variety of education, medicine, 
manufacturing, and library settings. 

I Internetworking 

The NREN is closely linked to the evolution of 
the Internet protocols that enable the thousands of 
independently operated networks that make up 
the Internet to exchange traffic. The testbeds are 
providing an opportunity to investigate the use of 
the Internet protocols in fast packet switched 
networks. The collaborative nature of the testbed 
program may be encouraging the Internet com- 
munity to influence the Al^ standards process to 
better support Internet protocols. In addition, the 
testbeds are investigating the behavior of the 
Internet protocols at high speeds, and conq)aring 
them to some new concepts in protocol design. In 
the past few years, a number of protocols have 
been proposed that may perform better in high-* 
speed networks and are better suited to the new 
fiber-based, fast packet switched networks. For 
example, today's Internet protocols are designed 
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Rgura 5-1— Growth In NSFNET Networks 

Number of foreign, regional, state and local networks 
December 1992 




SOURCE: MMt. Inc.. 1992. 



to handle il&e types of transmission errors that 
occur with poor-quality copper lines, but rarely 
occur with new fiber-based transmission systems. 

Other issues related to the evolution of the 
Internet protocols are not being studied by the 
testbeds. The main issue confronting the Internet 
community today is the growing size and com- 
plexity of the network — not increases in band- 
width. The growth in the number of users and 
networks that make up the Internet is putting 
pressure on current ''routing** technology (figure 
5-1). Routing is the process by which apath from 
one computer to another through a series of 
intermediate networks is determined. Calculating 
these paths using current algorithntis denkands a 
considerable amount of processing power; the 
problem is getting worse as the Intemet continues 
to grov. and become more complex. Routing 
issues have not been studied by the testbeds, 
which only connect a few sites. 

Work on issues related to managing the growth 
of the Intemet is being done primarily within the 
Intemet community's technical organizations, 
such as the Intemet Activities Board (lAB) and 
the Intemet Engineering Task Force (IETF). 



IETF consists of a number of woiking groqps, one 
of which addresses routing issues. Currently, 
within the technical conununity there are many 
different proposals; some only address immediate 
problems, while others attempt to solve the 
problems in a way that will be satisfactory for a 
number of years. Besides addressing issues re- 
lated to growth, some of the new routing algo- 
rithms may also take into account the growing 
diversity of service providers and network csp^r 
bilities. Routing and management problems asso- 
ciated with the growing Intemet are a major 
research area that requires more study.^^ 

NSF's plan for the evolution of its network as 
part of the NREN program is linked closely to 
changes in routing technology. Today, the 
NSFNET backbone operator plays an especially 
important role in determining routes for research 
and education networks. As the Intemet becomes 
more commercialized, however,, it becomes less 
appropriate for NSI to be responsible for this 
aspect of its operation. NSF envisions reducing 
the reliance of Intemet networks on the NSFNET 
backbone's operator for routing information.^^ 
NSF has proposed that the routing function be 
handled by a separate organization, the * 'routing 
authority,' ' not by the operator of NSF's network. 
NSF's plan also calls for the creation of a number 
of Netwoik Attachment Points (NAPs), where 
commercial networks and agency networks could 
obtain routing information and interconnect with 
each other (see box 5- A). 

APPLICATION TO OTHER NETWORKS 

The testbed program will also impact the 
evolution of the national information infrastruc- 
ture more directly, without the intermediate stage 
of deployment in the NREN. This national 
information infrastmcture includes the larger 
U.S. Intemet— the NREN program targets only 
one part of the U.S. segment of the Internet (sec 
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figure 5-2).^^ It also includes a wide array of other 
services and technologies to be offered by the 
carriers, cable television companies, computer 
hardware and software companies, information 
service providers and others. 

I Application to the Internet 

The Internet is increasingly expanding to serve 
communities other than the core research and 
education conmnmity that is the focus of the 
NREN program. The regional networks and new 
commercial providers now carry business traffic. 
The trends towards broader use of the Internet and 
growing numbers of users seem likely to con- 
tinue. ITiese will be driven in part by the advances 
in switching and transmission technology de- 
scribed in ch2q)ter 3. They depend to a greater 
extent on addressing the security concerns of 
commercial customers, the degree that use of 
Internet applications can be simplified, and the 
deployment of advanced digital local loop tech- 
nologies. 

It is possible that the switches and fiber optic 
links deployed by providers of agency backbone 
services will also carry commercial traffic. Some 
of the capacity would be used for the agency 
backbone network and some would be used to 
provide services to commercial customers. The 
Federal agency backbone would be the network*s 
most important customer, acting as a catalyst for 
the deployment of the required switches and 
transmission equipment, while commercial cus- 
tomers would help to recover that portion of the 
costs of operating the network not covered by the 
Federal agencies' funding. 

I Other Services 

The network technology studied by the 
testbeds is equally applicable to services other 
than Internet services. The research will also be 



Figure 5-2— Relationship Between NREN, 
Internet, and National Information Infrastructure 

National 
information 
infrastnicture 




SOURCE: Offio* of T«chnok>gy AttMsm^nt, 1993. 

applied directly to private networks, the conunon 
carriers* pubUc switched network, and possibly 
cable television networks.^^ Hiis is because the 
network technology used in the testbeds reflects 
near-term industry planning. While the testbeds 
have emphasized higher bandwidths and more 
specialized applications than have immediate 
commercial importance, the basic design of the 
testbed networks — such as the use of fast packet 
switching and SONET— reflects ideas that figure 
prominently \n industry plans. 

He carriers and other network operators could 
use the new advanced technologies to provide 
Internet services, or an array of other voice, video, 
and data communications senrices. Switch and 
transmission technologies, though advancing at 
different rates, are making substantial progress. 
Because of their commercial in^^rtance, fast 
packet and fiber optic technologies arc being 



12 1^ a diKiisiioQ of tbe reUtiooship of the Interact to the NREN, tee chiptcr 2, p. 31. 

t3 Fbr a description of a cMt providff'f plant to vte ATM tee Rkhwd Kirpinili, "Time Wim« to LEO: Here We Come." Teltphony, 
vol. 224. No. 5, Feb. 1. 1993, p. 8. IBM U testing iu ptaNET (FTM) fist pickU twitch in a cable network in Toronto. Canada. Sec "mM't 
t.2 Gisabit/tec. Networidflc Scheme,** Cable-Telco Report, Augutt 1992, p. 9. 
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Box 5*A— NSFNET Bacicbone Recompetition 

Ttw National Sdenctt Fbundatkxi's plans 
oonridmbto icmUny. The NSFNET ba^^ 

Reseafch and Education Network program. Curraniy, NSF has a cooporativa agreement with Mertt Network, a 
nol4or-promorganixation of nine Michigan universitias. However, Merit does not operate the NSi^NETbadtene 
nn-houee.** A eeoond organteation, Advanced Network a Service 
the servtoes for the NSFNET backbor^ from ANS. 

The cooperative agreement with Merit fa the NSFNET baddbone was announced in November 1987, and 
covered the 5-year perk)d fo November of 1 992. MeriTs proposal was submi 

The relationship between Merit and its partners changed in September of 1990, when Merit, BM, and MCI 
announced the formatkm of ANS, as a not4or-profit oorporatioa ANS received capital from MCI and BM at its 
formatk)n, and BM and MCI provkie switches, transmisskNi capacity, and other services to ANS. Overtkne, more 
of the responsUlities for the NSFNET backbone have been sMfted from Merit to its subcontractor, ANS. 

Overthe life ofthe 5-year cooperative agreement with Merit, there have beenthreeimportantch^ 
internet Rrst, Merit and ANS have increased the NSFNET backbone's link bandwkth from 56 kfa/s, to 1 .5 Mfa/s 
(T1), 10 45 Mfa/s (T3). Second, the Internot has become a much more important part of the U.S. informatton 
infFaslnjcture--the amount of traffic and the number of usera has gnwn 

the emergence of commercial Internet sen^provUere. In particular, ANS has created a for-profit subsUiary. 
While the T1 networit was used only by NSFNET backbone traffic, the T3networi( operated by ANS is sh^ 
the NSFNET bacid)one and ANS's commercial customers. 

The reiationdiip between NSF, Merit ANS, and other commerctai provkiers was the subject of hearings 
before the House Subcommittee on Science in March of 1992. Concern was expressed by some witnesses that 
the current arrangement ber»fited ANS unduly, and had not been foreseen by the 1987 cooperative agreement 
with Merit Other witnesses pointed to the success of the NSFNET bacMDone, the growth in the number of ueers, 
and the vahie of the equipment and services contributed by Merit and its partners. 

Recompetition 

In preparation for the expiration of the cooperative agreement with Merit in November of 1992, NSFstudi.x2 
a number of options for the future devefopment of the NSFNET backbone, in studying these optfons, NSF had 
to take into account several factors that dkl not apply in 1987. One factor was the emergence of commerdal 
provkjtors. Any new plan for the bacld)one coukS not favor the incumbent A^^ 
opportunity for aN firms wishing to provkfo services to the NSFNET bacM)on^ 

stability. The internet is now an essential kiraitnjcture for many more users than to 1 987, and stability wouU hove 
to be ensured during the transitton to any new arrengement RnaKy, NSF had to take into account the NSFNET 
baddxm's oeitral role in the NREN program. 

One option studied by NSFwastodiecontinue direct fonding of abackbone networie Instead, NSFoouidfund 
the regtonal networits and atfow them to chooee among commerctai provtoers of infteroonnecttons, encouraging 
further devefopment of the commerctai networi(S. According to testimony of the director of the NSF divisfon 
responsibfo for NSFI^, this plan was opposed by the regtonal networttt and b^ in part 

becauee of concerns about stability during the trensitton to this environment 

As a result NSF dectoed that it wouM continue to operate a backbone networic NSFs timetable caMed fa 
extending the arrengement with ANS for up to 18 months beyond November 1992, to the mkkie of 1994. This 
eighteen month period was intended to altow time to 1) setoct the provtoer of the next-generetton NSFNET 
backbone, and 2) install the required links and switohes. OriginaMy, NSF plan^ 
of 1993, aiowtog a year for the trensitton to the new networic 



ERLC 



60 



Chapter S— Application of Testt)ed Research 1 73 



The NSFNET Solicitation Concept 

ThaPrcjw^Oevilopfnont Plan Ibr the co^ 
of the i«reemwt with Merit was published by NSF in November of 1991. This dtvslopment plan stated the 
raquiremants for stiybility, Mr oompetitkia and 
the concept of splitting thi currant NSR^ bacW^ 
siparata organbations. 

NSF publishad a more detailed version of this plan in June of 1992 and requested public oommerAs. 
According to the plan, one of the two awards would be for the provisi^ 

Services (vBNS). The vBNS provider would operate the links and switchesand be responsi)le for moving packets 
through the NSFNET backbone. Among other requirements, the vBNS provkter wouM establish a network that 
wouM operate at 1 55 Mbps or higher and wouki **provkie for real-time multimedia services, inchJding multicasting 
and vkieoteieconferendng." NSFdM not specify a swik^hing ortransmissk>n technok)gy; however, the reference 
to 155 Mbpe implies the use of SONET transmisskm equipment 

The second award wouM be for the Fkwtlng Authority (RA). The routing authority woukii be responsibie for 
the routing functtons that had prevkxjsiy been performed by the backbone operator. The RA wouW also operate 
Networic Access Points (NAPs), whk:h woukl facilitate the connectkm of other networics to the vBNS and to each 
other. These couM be other FMeral networi(S, a commercial networics. The routing 
to tediltate the coordinatk3n of these networics wouM be stored in a database accessible at the N APs. A total of 
about $10 miflion annuaNy wouM be available for the two awards. 

Changes to the Drift Sollcltatton 

The public comments received by NSF in response to the draft proposal reflect the degree to whtoh NSFs 
plans affect more than just the NSFNET backbone. NSFs proposed NAP/RA stnjcture couki best be characterized 
as an "architecture" for the NREN and the internet, with sfgnifkxint impikatk}ns for the larger infbrmatkNi 
infrastnicture. As such, the NSFs plans affected users, interexchange and k)cal exchange carriers, regk)nal 
networics and other currert and prospectwe provkters of Internet servwea. and other federally supported networics. 

As of May, 1993, a revised verekxi of the NSF solk:itatk)n had not been released. However, in December 
1992, NSF outlined Its intentkxi to change its original plan in a number of ways. While the basic vBNS/NAP/RA 
stnjcture was maintained, NSF indkated that it wouM make three awards, not two. The NAPs wouM not have to 
be operated by the Routing Authority, as had been specified in the draft solk:ttatk>n, but couM be operated by a 
separate organizatk)n. 

More importantly, NSF announced that the new backbone wouW be used primarily to connect the NSF 
supercomputer centers. The draft sdKitatKMi had indkated that the new networtc woukl continue to be a "general 
purpose" backbone, serving a large number of sites and carrying both routine and high-end traff ». By limiting the 
scope of t he backbone, NSFs new approach wouki require more routine servtoes to be obtained from oommerdal 
prcvklers. 

SOURCES: Robert AIcm ct ai.. "NSF bnptomwUtkm Ptan for lntorag«ocy intarim NREN^ M«y 1M2; Natiooal SdMca F6undatk>n. 
"Projtct Davatopmant Ptan: Cortlmjatioo and Enbanotmaot of NSFNET BacMnna Sarvteia,*^ Novambar Natk)oaI Sdanoa 
Foundation. **NatworfcAooM Point Manao^/Routine Authority and V»ry High SpaadBa^ 

and tha NREN Pnqmit: Proy«n SoNdtation." Juna 1M2: Elwi Hoffman. "NSFNET Baohbona Sarvtoa Raatmcturad," Unk Umr, vol. 
5. No. 3. Noiwnbar 1M2. p. 1 ; DouglM E. van Houwalk)^. Martt Nati^ 
Sotonoa.Mar.l2,1sg2*pp.dS^l:StaphanS.WbW.AaaMantDlraclor.Olrac^ 
Natk)nal Sdanoa Foundatkm . taatfnwny athaarkiQS balora tha HouM Subo^ 

Wai«nLSd)fadar.PratidtntandCEO,P«rtomianoaSyitanwki»arnati^ Inc^ taatknony at haailn y bafof a tha Houaa Suboomm Ittaa 
on Sdma. Mar. 12, 1M2, pp. S7-SS: Miaomar. Changao Cou^ 

21 . p. 1 ; Offloa of Impactor Ganwal, National Solinoa Foundation. "Raviaw of NSFTCT." Mar. 23. 1M3. 
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studied by a large number of research programs in 
addition to the testbeds. The issues affecting the 
deployment of these technologies in commercial 
settings are mainly concemed with trading the 
costs associated with the existing infrastructure 
against the potential of future markets for the new 
technologies. Regulatory and economic factors 
affecting the pace of deployment a:e beyond the 
scope of this background ps^er. 

The involvement of the carriers in the testbeds 
was an important result of the visibility afforded 
by the HPCC program and the Corporation for 
National Research Initiatives' organization. All 
three major interexcbange carriers and most of the 
Regional Bell Operating Companies are involved. 
The focus on ATM-related issues serves to 
provide experience with the construction of these 
networks and demonstrate their feasibility on a 
significant scale. Despite the carriers' stated 
commitment to ATM, the degree to which the 
transition to ATM represents a true paradigm shift 
for the telecommunications industry should not 
be underestimated. The testbeds will have served 
to help advance the carriers beyond the stage of 



standards-setting, conq>onent development, and 
small-scale experiments. There are many who 
believe that a nationwide gigabit network is not 
possible without basing it on the ongoing invest- 
ments of the caniers.^^ 

The testbeds may also be helping to provide 
input to the ATM standards process. Currendy, 
there is some concern in the telecommunications 
industry that elements of ATM are being stand- 
ardized before there is sufficient understanding of 
me trcdeoffs. In particular, there is uncertainty 
about the best way to control the traffic in ATM 
networks, a key component in the use of ATM to 
support integrated services. The testbeds will 
provide experience with real traffic, due to the 
involvement of applications researchers. The 
academic researchers are also contributing to the 
solution of these problems; while algorithms for 
the control of packet networks are a longstanding 
topic of theoretical research, the testbeds may 
serve to focus the work of academic researchers 
on topics of concern to industry to a greater 
extent. 
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